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ABSTRACT 


This  thesis  discusses  and  implements  an  interactive  decision  support  system  using 
a  Prescriptive  Garbage  Can  Model.  The  fundamental  presumtion  is  that  if  the  choice- 
outcome  relationships  in  an  organization  can  be  observed  and  evaluated,  it  is  possible 
to  extract  predictiveness  from  uncertain  streams,  and  allow  the  organization  to  shift  to 
a  less  random  strategy.  Solving  organizational  problems  consists  of  selecting  those 
choices  that  lead  the  organization  in  a  direction  towards  the  ideal  state.  Thus,  it  is 
convenient  to  model  the  organizational  state  transitions  as  a  Markovian  process  with 
stationary  properties.  The  purpose  of  a  Prescriptive  Garbage  Can  Model  is  to  advise 
the  participants  of  the  choices  available  in  a  current  situation,  and  to  present  choice 
policies  leading  the  highest  potential  benefits.  Also  a  method  of  interfacing  the  current 
system  with  an  expert  system  for  intelligent  decision  making  is  examined. 
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I.  INTRODUCTION 


The  Prescriptive  Garbage  Can  Model  (PGCM)  of  organizational  decision-making 
[Refs.  1,2]  can  be  defined  as  chance  events  resulting  from  the  interactions  of  four 
elements  in  the  organizational  context,  (i)  problems,  (ii)  solutions,  (iii)  participants,  and 
(iv)  choice  opportunities.  As  with  every  anarchic  and  random  system,  the  participants 
desire  to  solve  the  current  problem  in  the  most  effective  manner.  Which  problems  are 
actually  taken  up  for  action,  in  what  priority,  what  choices  are  made  in  solving  them, 
and  how  conclusively  they  are  solved,  are  all  functions  of  ambiguous  preferences,  and 
time  and  energy  constraints  of  the  participants, 

A  model  imparting  some  degree  of  structure  and  comprehensibility  to  the 
complex  organizational  interactions  and  suggesting  rational  choice  policies  in  an 
otherwise  irrational  context  may  be  of  invaluable  assistance  to  organizational  decision¬ 
makers.  Thus,  the  model  is  prescriptive  in  nature.  The  building  of  such  a  model  would 
link  rational  decision-making  [Refs.  1,3]  with  anarchic  decision-making  [Ref.  2] 
thought. 

Three  objectives  of  the  model  are  the  following  : 

1.  Advise  the  participants  of  the  choices  available  to  them  in  a  specific 
organizational  state 

2.  Estimate  the  expected  benefit  resulting  from  each  choice 

3.  Lay  down  choice  policies  which  would  assist  the  participants  in  leading  the 
organization  in  the  long  run  to  the  state  that  has  the  highest  potential  benefits 

Under  severe  lack  of  knowledge,  decision  makers  may  adopt  a  random  search  and 
choice  rule,  i.e.,  decisions  are  ill-defined,  inconsistent,  unclear,  uncertain  and 
problematic.  Learning  and  outcomes  are  a  matter  of  accidental  trial-and-error. 

While  random  strategies  are  always  available,  one  may  wonder  whether  they  can 
be  imbued  with  conscious  thought  processes  to  deal  with  uncertainty  more  effectively. 
If  the  choice-outcome  relationships  in  an  organization  can  be  observed  and  evaluated, 
it  is  conceivable  to  extract  predictiveness  from  uncertain  streams,  and  thereby  allow  the 
organization  to  shift  to  a  less  uncertain  strategy,  in  particular  toward  cybernetic  and 
stochastic  decision  procedures. 

This  study  discusses  the  design  and  implementation  of  the  Prescriptive  Garbage 
Can  Model  to  provide  a  best  course  of  actions  on  the  anarchic  organizational  system. 


Chapter  II  provides  background  on  the  prescriptive  organizational  model  of  garbage 
can  choice  policies.  This  includes  a  stochastic  approach  to  the  garbage  can  model, 
definitions  and  assumptions  about  the  components  of  PGCM,  and  a  prescriptive  model 
of  organizational  choice.  Chapter  III  examines  the  decision  making  process  and 
discusses  the  design  and  implementation  using  a  military  offensive  operation  example. 
Chapter  IV  contains  recommendations  for  further  study  on  the  topic.  Appendix  A  is 
the  source  program.  Appendix  B  is  the  user  manual  for  the  current  implementation. 
Appendix  C  is  a  demonstration  how  offensive  operation  decision  choices  could  be 
taken.  Appendix  D  is  a  demonstration  how  university  schedule  decision  choices  could 
be  taken. 


II.  BACKGROUND 


A.  A  STOCHASTIC  APPROACH  TO  THE  PRESCRIPTIVE  GARBAGE  CAN 

MODEL 

What  appears  on  the  surface  as  random  organizational  behavior  is  most  likely 
not  totally  random,  but  casually  influenced  by  a  series  of  external  factors  and  internal 
choices  that  can  be  modelled  as  probabilistic  phenomena.  It  is  often  the  difficulty  of 
understanding  numerous  organizational  and  environmental  forces  that  act 
simultaneously  which  renders  probabilistic  processes  to  appear  as  random  occurrences. 
Thus,  it  may  be  useful  to  assume  that  organizations  are  ultimately  more  probabilistic 
in  nature  than  purely  random.  The  probabilistic  approach  obviously  implies  an 
inevitable  degree  of  indeterminancy. 

The  prescriptive  garbage  can  process,  whereby  problems,  solutions,  choices  and 
participants  are  in  organizational  confluence,  is  made  up  of  a  large  number  of  distinct 
actions  sequenced  over  time.  At  any  point  in  time,  an  organization  can  be 
characterized  as  belonging  to  a  discrete  organizational  state.  An  organizational  state  is 
the  conditional  wherein  essential  characteristics  of  the  organization  (i.e.,  state 
variables)  take  on  distinct  and  measurable  values.  During  the  fleeting  existence  of  the 
organization  in  a  specific  state,  if  the  participants  were  seeking  globally  optimal 
decisions,  they  would  endeavor  to  identify  the  current  state  of  the  organization  and 
exercise  one  of  the  choices  that  are  available  to  them  in  that  state.  However,  the  effect 
of  a  decision  may  not  be  fully  predictable.  Thus,  while  a  decision  might  be  attractive 
in  terms  of  an  intended  effect,  an  accurate  decision  calculus  may  not  always  be 
possible.  Stated  thus,  organizational  flux  can  be  described  as  consisting  of  a  stream  of 
single-step  state  transitions  over  time  due  to  the  series  of  decisions  made  by  the 
participants.  In  this  perspective,  stochastic  modeling  techniques  may  be  applied  to 
tame  the  transition  phenomenon  [Ref.  1]. 

Despite  the  probabilistic  nature  of  the  organization  processes,  organizational 
structures  are  ultimately  considered  to  be  homeostatic.  This  homeostasis  concept 
relates  to  the  capacity  of  the  organization  to  withstand  random  perturbations  which 
have  not  been  foreseen  by  the  participants  [Ref.  1].  According  to  cyberneticians,  an 
organization  may  be  in  any  of  the  enormous  number  of  possible  states  with  related 
choice  opportunities.  Solving  organizational  problems  consists  of  selecting  those 


choices  that  lead  the  organization  in  a  direction  towards  the  ideal  state.  Thus,  it  is 
convenient  to  model  the  organizational  state  transitions  as  a  Markovian  process  with 
stationary  properties.  A  process  is  stationary  when  organizational  states  become  stable 
and  invariant  under  time  shifts.  The  homeostatic  nature  of  the  organizations  implies 
the  operation  of  at  least  some  stationary  properties. 

B.  DEFINITIONS  AND  ASSUMPTIONS 

1.  Organizational  Elements 

As  defined  in  the  PGCM,  any  organization  consists  of  four  relatively 
independent  elements.  They  are  (i)  problems,  (ii)  solutions,  (iii)  participants,  and  (iv) 
choices.  Relative  independence  implies  that  each  element  can  assume  its  own  identity, 
existence  and  relevance.  In  addition,  we  presume  that  problems  are  triggered  by 
external  or  internal  factors  and  represent  the  mismatch  between  the  current 
organizational  state  and  the  desired  state.  Solutions  are  either  tools  or  answers  directlv 
available  within  the  organization  waiting  to  be  bound  to  the  appropriate  problems. 
Participants  with  their  limited  stocks  of  energy  focus  their  attention  on  important 
problems  and  search  for  attractive  solutions.  Choices  act  as  a  cementing  factor  that 
ties  the  above  three  elements  together. 

2.  Organizational  States 

The  organizational  state  Z-  is  a  function  of  three  attributes  which  describe  an 
organization  at  a  certain  point  in  time.  These  attributes  are  : 

1.  The  importance  of  the  problems  remaining  to  be  solved  (P-), 

2.  The  effectiveness  of  the  solutions  applied  to  problems  (S^)  in  the  recent  past. 

3.  The  energy  levels  of  the  participants  available  for  problem-solving  (Ej). 

The  choice  of  P,  S  and  E  as  attributes  of  organizational  states  is  motivated  by 
the  structure  of  the  PGCM  which  employs  these  elements  as  building  blocks.  P,  S  and 
E  are  assumed  to  be  independent  and  measurable  attributes.  For  convenience  of 
representation,  we  shall  use  the  coordinate  system  to  denote  a  state.  Thus  an 
organizational  state,  Zj  =  (  P-  ,  S-  ,  Ej  ). 

3.  Choices 

Choices  are  decisions  taken  by  participants  in  their  pursuit  to  solve  problems. 
They  are  determined  by  judging  the  nature  of  problems  remaining  to  be  solved,  the 
effectiveness  of  the  considered  solutions,  and  the  energy  input  available  from  the 
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participants  required  of  a  particular  choice.  In  an  organized  anarchy,  choices  are 
assumed  to  be  made  accidentally.  However,  if  choices  were  to  be  made  rationally 
amidst  the  anarchy,  they  would  presumably  carry  the  organization  towards  the  state 
(0,1,1).  Rational  managers  would  prefer  such  a  state  because  they  would  like  to  see  as 
many  of  the  remaining  important  problems  solved  as  possible,  in  an  effective  manner, 
and  have  at  their  disposal  at  all  times  a  adequate  supply  of  energy  that  can  be  applied 
to  future  problem  solving.  This  is  not  to  imply  that  managers  wish  to  remain  absorbed 
in  state  (0,1,1),  since  this  means  no  opportunities,  eternal  calculations  and  unexpended 
energy.  Rather,  managers  would  prefer  to  attain  a  dynamic  equilibrium  at  or  close  to 
(0,1.1).  At  such  equilibrium,  there  is  a  continuous  flow  of  problem  opportunities  and 
their  effective  resolution  in  a  timely  fashion  so  that  sufficient  manpower  energy  is 
readily  available  to  meet  new  problem  opportunities  as  soon  as  they  arise. 

In  general,  selecting  a  choice  induces  the  transition  of  the  organization  to  a 
new  state  in  the  next  time  interval.  It  is  possible  that  taking  no  decisions  is  a  choice  in 
itself.  It  can  shift  the  current  state  to  a  new  state  with  more  problems. 

4.  Choice  Policies 

Choice  policies  provide  a  prescriptive  approach  to  problem  solving.  Once  a 
set  of  organizational  states  and  associated  choices  available  therein  can  be  identified,  it 
is  possible  to  bring  to  bear  rationality  in  decision-making  by  laying  dowm  choice 
policies.  Choice  policies  consist  of  suggestions  as  to  what  choices  should  be  preffered 
while  the  organization  is  perceived  to  be  in  a  particular  state.  In  a  sense,  choice 
policies  form  a  set  of  guidelines  for  organizational  decision  makers.  Usually,  the  choice 
policies  are  so  recommended  as  will  most  likely  bring  in  the  maximum  benefits  for  the 
organization  in  the  long  run. 

C.  A  PRESCRIPTIVE  MODEL  OF  ORGANIZATIONAL  CHOICE 
1.  Organizational  Flux  as  Stochastic  Transitions 

Introducing  rationality  into  an  anarchic  system  requires  that  the  decision¬ 
makers  observe  a  calculus  of  outcomes  based  upon  the  (i)  understanding  of  the 
implications  of  the  various  organizational  states,  (ii)  knowledge  of  all  the  choices 
available  to  them  in  each  state,  and  (iii)  assessment  of  the  probable  impact  of 
exercising  a  choice  on  the  current  state,  before  they  reach  a  decision.  We  infuse 
rationality  into  the  Prescriptive  Garbage  Can  Model  of  anarchic  actions  through  the 
use  of  a  transition  probability  matrix. 
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The  transition  probability  matrix  represents  the  various  organizational  states, 
the  available  choices  under  each  state,  and  the  probabilities  with  which  a  choice  can 

take  the  organization  from  one  state  to  another.  Z-  ,  i  =  1 . n,  denotes  the 

organizational  states;  Cj  (k),  k  =  1 . ,  the  choices  available  in  a  state  i;  q- 

c(k),  the  probability  that  the  initial  state  Z'  will  transit  to  Zj  when  some  choice  C1  (k) 
is  taken.  Implicit  in  the  matrix  is  the  fact  that  there  is  no  guarantee  a  choice  can 
always  lead  to  a  state  that  is  predictable  beforehand.  Impossible  states  may  be  filtered 
out  from  the  matrix  altogether  and  infeasible  transitions  may  be  represented  by  zeros. 
Note  that  Xj^ij  ci  (k)  ~  1-  For  simplicity  of  notation,  we  omit  the  subscript  i  in  Cj  (k), 
and  denote  by  c(k). 

The  prescriptive  model  requires  the  determination  of  the  transition 
probabilities.  While  several  methods  have  appeared  in  the  literature  in  estimating 
subjective  probabilities,  one  that  has  evoked  considerable  interest  in  recent  years 
consists  of  systematic  elicitation  of  expert  judgement  [Refs.  1,4,5].  Expert  knowledge 
and  opinions  often  form  an  adequate  surrogate,  when  historical  data  seem  either 
inapplicable  or  unavailable. 

The  following  steps  describe  the  mechanics  of  generating  the  transition 
probability  matrix  : 

•  Step  1  -.  Determination  of  the  set  of  organizational  states,  n. 

First,  determine  the  number  of  possible  values  p  can  take.  For  this  divide  the 
scale  (0,1)  into  as  many  scale  points  as  possible,  say  r.  Assuming  these  scale  points  are 
uniformly  distributed,  the  value  of  each  scale  point  pu  can  be  generated  using  the 
formula, 

pu  =  (u-1)  /  (r-1),  where  u  =  1  r. 

For  example,  if  r=3,  then  p1  =  0,  p“  =  0.5,  pJ  =  1.  The  same  formula  can  be 
applied  to  determine  the  scale  points  for  S  and  E.  The  value  of  r  need  not  have  the 
same  value  for  P,  S,  and  E. 

Second,  generate  all  possible  combinations  of  Pu  ,  Su  ,  Eu  to  determine  all 
organizational  states.  If  r=2  for  P,  S  and  E,  then  the  different  organizational  states 
can  be  described  by  one  of  the  combinations,  (P^,  S*,  E*),  (P*,  S*,  E2),  (P1.  S2,  E*), 
(P1.  S2,  E2),  (P2,  S1,  E1),  (P2,  S1,  E2),  (P2,  S2,  E1),  and  (P2,  S2,  E2).  In  general, 
assuming  the  partitions  are  equal  for  P,  S  and  E  (rp  =  r?  =  rg)  the  maximum  number 
of  possible  organizational  states  that  can  be  represented  using  the  (P,S,E)  coordinate 
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form  is  thus  r^.  If  r=  2,  these  states  can  be  denoted  by  Zj  =  (P-,  S-,  Ej)  where  i  =  1 

8.  Thus,  Z1  =  (P1,  S1,  E1),  Z2  =  (PI.  S1,  E2) . Zg  =  (P2,  S2,  E2). 

Note  that  once  each  possible  combination  (Pu,  Su,  Eu)  is  assigned  to  a  specific  state 
Z-,  i=  l,...,n,  the  actual  values  of  P,  S,  E's  in  any  state  thereafter  be  refered  to  by  Pj,  Sj 
and  Ej.  The  following  Table  1  represents  each  organizational  states. 


State  Z 

TABLE  1 

AN  EXAMPLE  ORGANIZATIONAL  STATE 

( ,  Ej_)  Remarks 

1 

(0.0,0.  0,0.0) 

2 

(0.  0,0.  0,1.  0) 

3 

(0.0,1. 0,0.0) 

4 

(0.0,1. 0,1.0) 

5 

(  1.  0,0.  0,0.  0) 

6 

(  1.  0,0.  0,1.  0) 

7 

(  1.  0,  1.  0,0.  0) 

8 

(1.0, 1.0, 1.0) 

•  Step  2  :  For  each  of  the  states  Zj  ,  identify  and  filter  all  the  conceivable  and 
feasible  choices. 

Collect  all  these  choices  to  form  a  set  defined  by  Dj  =  c(k),  where  k  =  1, 

...,  rrij.  In  complex  organizations,  exhaustive  enumeration  of  choices  may  be  a  difficult 
task.  However,  it  is  not  unrealistic  for  organizations  to  anticipate  and  equip 
themselves  with  as  many  available  choices  as  they  can  to  meet  different  possible 
situations. 

•  Step  3  :  For  an  initial  state  Zj  ,  pick  one  of  available  choices 

As  a  result  of  c(k),  assume  the  organization  enters  state  Z:. 

•  Step  4  :  Estimate  the  probabilities  P,  S,  E 

Ppj  ,  pj  c(k),  where  j  =  1 . n  and  ,  j  c(k)  =  1.  Repeat  for  elements 

S  and  E.  This  gives  2pi  ,  j  c(k)  ,  and  Epi  ,  pj  c(k). 
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•.  Step  5  :  Compute  the  row  of  the  transition  probability  matrix  using  the 
following  formula 


%  c(k)  =  £pi  -  pj  c<k)  *  £pi  •  pj  c(k)  *  £pi  -  pj  c(k)  (eqn  2.1) 

herein,  we  notated  P  ,  S  .  E  as  estimation  probabilities  of  P,  S,  E 

•  Step  6  :  Repeat  for  all  remaining  (rr^  -  1)  choices  in  Z{. 

•  Step  7  :  Repeat  steps  3-6  for  the  remaining  (n  -  i)  states. 

The  general  layout  of  the  transition  probability  matrix  is  shown  Figure  2.1. 


Zl,  C(  2  )  qllC(2)  ql2C(  2  )  ql3C(  2 
Zl',  C(  ml )  qllC(ml)  ql2C(ml)  ql3C(ml) 

22,  C(l)  q21C(l)  q22C(  1 )  q23C(l) 

22  ,  C(  2  )  q21C(  2  )  q22C(  2  )  q23C(2) 

Z2 ,  C(  m2  )  q21C(  m2  )  q22C(  m2  )  q23C(m2) 

23  ,  C(l)  q3 1C(  1 )  q32C(l)  q33C(l) 

23,  C( 2 )  q31C( 2 )  q32C(2)  q33C(2) 

23*,  C(  m3  )  q31C(  m3  )  q32C(  m3  )  q33C(m3) 


qlnC( 2 

qlnC(  ml ) 

q2nC(  1 ) 
q2nC(  2 ) 

q2nC( m2 ) 

q3nC( 1) 
q3nC( 2 ) 


q3nC( m3 ) 


2n,  C(mi)  qnlC(mi)  qn2C(mi)  qn3C(mi)  ...  qnnC(mi) 


Number  of  states 


=  Z( 1,  ...  ,  n) ; 


Number  of  choices  in  each  state  =  C(l,  ...  ,  mi ) ; 

Transition  probability  matrix  satisfies  the  condition 

Xj  qAj  C(k)  =  1,  for  k  =  1,  ...  ,  m± 


Figure  2.1  An  Example  Transition  Probability  Matrix. 


2.  Goodness  Measure  of  an  Organizational  State 

For  each  organizational  state  Zx  ,  vve  assume  there  is  an  associated  measure  of 
goodness,  gj.  This  measure  is  ordinal  in  nature  and  reflects  the  amount  of  benefit 
derivable  from  the  values  of  P,  S  and  E  corresponding  to  each  state.  The  idea  is 
similar  to  a  balance  sheet  which  conveys  the  state  of  health  of  an  organization.  S  and 
E  can  be  viewed  as  assets  in  a  balance  sheet,  since  they  represent  the  strength  of  the 
organization.  On  the  other  hand,  P  can  be  viewed  as  a  liability  in  that  it  detracts  from 
the  organizational  performance.  Note  that  high  values  of  Sj  and  Et  imply  high  values 
of  g-.  Conversely,  high  values  of  Pj  imply  low  values  of  g-.  The  composite  amount  of 
goodness  for  the  state  Zj  can  be  expressed  as  follows  : 


"  *  Pi  +  Si  +  Ei 


(eqn  2.2) 


In  theory,  the  ideal  state  of  the  organization  corresponds  to  g  =  2,  since  P  = 
0,  S  =  1,  and  E  =  1.  Contrarilv,  for  the  anti-ideal  state,  g  =  -1,  since  P  =  1,  S  =  0 
and  E  =  0.  The  following  Table  2  shows  each  goodness  measurement. 


TABLE  2 

AN  EXAMPLE  GOODNESS  MEASUREMENT 


State  Zi 


(0.  0,0.  0,0.  0) 
(0.0,0. 0,1.0) 
(  0.  0,1.  0,0.  0) 

(  0.  0, 1.  0, 1.  0) 

(  1.  0,0.  0,0.  0) 

(  1.  0,0.  0,1.  0) 

(1.0, 1.0, 0.0) 
(  1.  0,1.  0,  1.0) 


Goodness  Remarks 


3.  Transition  Benefit 

The  goodness  measure  of  an  organizational  state  can  be  related  to  the 
transition  probabilities  through  the  idea  of  transition  benefit.  Transition  benefit  is  the 
expected  incremental  goodness  due  to  a  transition  that  results  from  a  specific  choice. 
It  is  calculated  as  follows. 

•  Step  1  :  Difference  of  goodness  value  between  current  state  Zj  and  terminal 
state  Zj  for  choice  c(k) 

(gj  -  gj)c(k)  =  -  (PjC(k)  -  Pl}  +  (SjC(k)  -  Si}  +  (EjC(k)  -  Ej)  (eqn  2.3) 

•  Step  2  :  Expected  incremental  benefit  (G)  of  the  choice 

G  (Zj  ,  c(k))  =  Yj  (gj  -  gj)c(k)  *  qjjC(k)  (eqn  2.4) 

If  there  are  n  states  and  ]Tj  mj  choices,  the  transition  benefit  matrix  will  be 
dimension  of  n  x  ]Tj  rrij. 

4.  Identification  of  a  Choice  Policy 

We  have  seen  that  policy  is  a  prescriptive  function.  Its  purpose  is  to  suggest 
which  choice  c(k)  out  of  the  possible  set  of  choices  c(  1 ,2,  ...  rrij)  must  be  acted  upon, 
given  the  organization  is  in  state  Zj  If  rationality  in  decision  making  is  assumed, 
choices  will  have  to  be  so  exercised  as  to  maximize  gj.  This  can  be  achieved  by 
maximizing  the  sum  of  the  expected  selection  and  sequencing  of  the  different  choices. 
Howard's  algorithm  can  be  employed  to  perform  the  maximization  [Refs.  6,7],  The 
algorithm  is  applicable  while  dealing  with  a  stochastic  process  where  the  law  of 
transition  and  the  corresponding  benefit  function  are  known.  It  consists  of  an 
intelligent  trial  and  error  iterative  procedure  that  selects  the  best  beneficial  choice  for 
each  state  in  each  iteration  until  the  long  run  expected  mean  income  per  choice  is 
maximized.  The  following  one  is  the  dynamic  programming  formulation. 


V(S)  =  max{i(S,a)  -  g  +  Y  v(s)q^  ,  s  C(a)},  for  s  =  1,  ..  .  S 


(eqn  2.5) 


Note  S  :  initial  state,  s  :  next  state,  g  :  maximum  mean  income  per  period,  a  :  chosen 
action,  q§  s  C(a)  :  transition  probability  that  transit  from  initial  state  S  to  next  state  s 
when  action  a  is  chosen. 

5.  Reinforcement  of  Choice  Policies  through  Learning/ Revision 

From  a  cybernetic  perspective,  generating  a  choice  policy  is  a  learning  process. 
The  organization  should  continually  examine  the  outcomes  following  from  the  choices 
it  made  in  the  previous  periods,  reinforce  the  assessments  of  the  organizational 
elements  P,  S  and  E,  and  revise  its  battery  of  choices.  This  results  in  the  re-evaluation 
of  the  transition  probability  matrix  and  consequently  leads  to  a  new  set  of  choice 
policies  for  the  next  period. 


III.  SOFTWARE  DESIGN  AND  IMPLEMENTATION 


A.  DECISION  MAKING  PROCESS 

The  Prescriptive  Garbage  Can  Model  refers  to  a  class  of  systems  which  support 
the  process  of  making  decisions.  The  decision  maker  can  retrieve  data  and  test 
alternative  solutions  during  the  process  of  problem  solving.  This  system  also  should 
provide  ease  of  access  to  the  data  base  containing  relevant  data  and  interactive  testing 
of  solutions.  The  system  analyst  must  understand  the  process  of  decision  making  for 
each  situation  in  order  to  analysis  a  system  to  support  it.  The  model  proposed  by 
Herbert  A.  Simon  consists  of  three  major  phases  [Ref.  9],  they  are  (i)  intelligence 
phase,  (ii)  design  phase,  and  (iii)  choice  phase. 

1.  Intelligence  Phase 

Searching  the  environment  state  calling  for  decisions.  Estimation  data  are 
obtained,  and  examined  for  clues  that  may  identify  problems;  set  all  estimation 
probabilities.  One  of  the  important  fact  is  how  to  formulate  the  problems.  A  problem 
formulation  might  have  a  risk  of  solving  the  wrong  problem,  but  the  purpose  of 
problem  formulation  is  to  clarify  the  problem  so  that  design  and  choice  activities 
operate  on  the  right  problem  [Ref.  9).  Frequently,  the  process  of  clearly  starting  the 
problem  is  sufficient;  in  other  cases,  some  reduction  of  complexity  is  needed.  Four 
strategies  for  reducing  complexity  and  formulating  a  manageable  problem  are  [Ref.  9] 

•.  Determining  the  boundaries 

•.  Examining  changes  that  may  have  precipitated  the  problem 
•.  Factoring  the  problem  into  smaller  subproblems 
•.  Focusing  on  the  controllable  elements 

A  Prescriptive  Garbage  Can  Model  can  obtain  intelligence  through  searching, 
hence  allow  the  user  to  approach  the  task  heuristically  through  trial  and  error  rather 
than  by  preestablished,  fixed  logical  steps.  So  establishing  analogy  or  relationship  to 
some  previously  solved  problem  or  class  of  problems  is  useful. 

2.  Design  Phase 

Inventing,  developing,  and  analyzing  possible  courses  of  choices  is  performed 
in  this  phase.  It  involves  processes  to  understand  the  problem,  to  generate  solutions 
and  to  test  solutions  for  feasibility.  "A  significant  part  of  decision  making  is  the 


generation  of  alternatives  to  be  considered  in  the  choice  phase"  [Ref.  10].  The  act  of 
generating  alternative  is  creativity  that  may  be  enhanced  by  alternative  generation 
procedures  and  support  mechanisms.  In  this  process,  an  adequate  knowledge  of  the 
problem  area  and  its  domain  knowledge,  and  motivation  to  solve  the  problem  will  be 
required.  Given  these  situations,  analogies,  brainstorming,  checklists  can  enhance 
these  creativities  [Ref.  9]. 

3.  Choice  Phase 

Selecting  an  choice  from  those  available  by  using  decision  making 
software(.i.e.,  PGCM),  can  establish  all  choices  for  each  organizational  state. 

B.  DESIGNING  THE  PGCM  HIERARCHY  AND  DFD 

1 .  Hierarchical  Program  Structure 

To  process  the  PGCM,  we  first  set  up  estimation  probabilities  and  alternative 
actions  through  intelligence; design  phase.  Then  we  also  establish  choice  policies 
through  choice  phase.  Herein  we  focus  on  the  choice  phase  that  consists  of  two 
procedures.  One  is  to  produce  all  matrices  such  as  organizational  states,  transition 
matrix,  goodness  measure  table,  benefit  matrix  from  given  user 
requirements,  specification.  The  other  one  is  to  apply  these  matrices  to  generate  long 
run  policy.  Figure  3.1  shows  the  modules  that  are  invoked  by  the  main  PGCM 
program.  As  we  see,  each  of  modules  is  a  black  box  that  takes  input  data,  performs 
some  transformation  on  that  data,  and  process  output  data. 

2.  Data  Flow  Diagram 

Since  we  are  establishing  modules  as  functional  elements,  we  need  to  know 
what  are  the  inputs, outputs.  So  for  each  module  we  will  use  a  simple  black  box 
diagram  to  show  the  data  flow  of  PGCM.  For  example,  in  Figure  3.2,  there  is  a 
module  labeled  benefit  matrix.  Independent  of  all  other  modules  in  the  program,  we 
need  transition  matrix  and  goodness  measure  table.  The  followings  are  the 
inputs  outputs  parameters  for  each  module  [Ref.  11], 

**  Module  Getinfo  {level  1.1)  ** 

inputs  :  number  of  scale  points  for  each  factor  (rp  ,  rg  ,  rg) 
number  of  different  choices  for  each  state 
estimation  probabilities 
process:  store  input  data  via  user  interaction 


process:  calculate  transition  probability  using  formula  2.1 
output :  transition  probability  matrices  (size  :  n  *  (£  mj  *n)) 


Figure  3.2  Data  Flow  Diagram  for  PGC.M. 


**  Module  Getgoodness  (level  1.4)  ** 

input  :  organizational  state  table 

process:  calculate  goodness  measure  using  formula  2.2 

output  :  goodness  measure  table  (size  :  n) 
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**  Module  Getbenefit  (level  1.5)  ** 
inputs  :  transition  probability  matrices 
goodness  measure  table 

process:  calculate  transition  benefit  probability  using  formula  2.3,  2.4 
output  :  transition  benefit  matrix  (size  :  n  *  maxchoice) 

**  Module  Initialize  (level  2.1)  ** 
input  :  transition  benefit  matrix 

process:  select  best  choices  for  each  state  from  transition  benefit  matrix  that 
has  the  highest  value  in  that  state 

output  :  policy  table  (size  :  n) 

**  Module  Dynamicformulation  (level  2.2)  ** 
inputs  :  transition  benefit  matrix 

transition  probability  matrices 
temporary  policy  table 

process:  fill  the  coefficient  table  need  to  solve  equations  described  by  formula  2.5 
output  :  coefficient  table  (size  :  n  *  n  +  1) 

**  Module  Resolvevariable  (level  2.3)  ** 
input  :  coefficient  table 

process:  resolve  variable  using  gaussian  elimination  method 
output  :  variable  values 

**  Module  Setnewaction  (level  2.4)  ** 
inputs  :  variable  values 

transition  benefit  matrix 
transition  probability  matrices 
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process:  set  a  new  policy  using  howard  algorithm 
output :  new  policy  table 
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C.  PGCM  PROCESS  ALGORITHM 

1.  Input  Data  via  Terminal 

The  current  PGCM  system  needs  to  know  number  of  scale  points  for  each 
factor,  different  number  of  choices,  and  the  estimation  probability. 

2.  Generate  Transition/ Benefit  Probability( formula  2. 1,3,4) 

3.  Value  Determination  Operation 

a)  establish  n  linear  simultaneous  equations  (v-  ,  g). 

:  use  qj-  and  i(S,a)  for  a  given  policy  to  solve 

g  +  Vj  =  i(S,a)  +  V  q jj  v^  i  =  1,2,  n 

b)  set  arbitary  Vj  equal  to  0,  normally  vn 

c)  resolve  and  produce  the  relative  values  using  gaussian  method. 

4.  Policy  Improvement 

a)  find  the  alternative  C(k)  that  maximizes  the  test  quantity  (v-  ,  g). 

:  find  max(i(S,a)  C(k)  +  V  q..  C(k)  v-^  using  the  relative  values 

v-  of  the  previous  policy,  then  C(K)  becomes  the  new  decision  in  the 
ith  state,  i(S,a)  C(K)  becomes  i(S,a),  and  q-  C(K)  becomes  q- 

b)  perform  this  procedure  for  every  state,  and  determine  a  new  policy. 

5.  Combined  Operation  in  An  Iteration  Cycle 

a)  select  an  initial  policy  from  immediate  benefit  values. 

b)  solve  the  relative  values  Vj  and  g  by  setting  vn  to  0. 

c)  find  an  alternative  that  has  maximal  benefit  values. 

d)  if  all  alternatives  are  equally  same  benefit  values,  leave  it  unchanged 

1)  sort  benefit  values  (1  ..  choice(.n.)) 

2)  calculate  absolute  difierence  for  each  benefit  values 

3)  if  a  difference  is  less  than  0,0001,  take  an  old  action  else  set 

a  new  action 
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e)  repeat  until  the  policies  on  two  successive  iterations  are  identical 

f)  if  gain  value  g  is  decreased,  then  set  arbitary  v-_  ^  equal  to  0, 
and  repeat  step3  thru  step  5  until  satisfied 

The  above  algorithms  step  3  thru  step  5  based  on  the  policy  iteration  method 
for  multiple  chain  processes  [Ref.  6], 

D.  IMPLEMENTATION  WITH  OFFENSIVE  OPERATION  EXAMPLE 

Decision  making  in  battle  field  involves  unclear  problems,  chance  event  solution:, 
fluid  energy  derived  from  participants,  and  choices  that  seldom  resolve  problems.  At 
any  moment  in  time,  a  battle  field  may  have  a  large  number  of  problems  to  deal 
with,  different  possible  solutions  to  cope  with  these  problems,  and  many  participants  to 
make  the  necessary  choices.  Since  taking  into  account  all  of  the  problems 
simultaneously  could  confuse  the  illustration,  we  shall  assume  that  there  is  only  one 
problem  to  be  addressed  during  the  interval  of  time  considered  and  that  the  problem  is 
related  to  offensive  operation.  We  assume  the  representative  elements  in  the  offensive 
operation  are  number  of  attack  forces,  weapon  systems,  weather,  relation  to  the 
consequent  military  operation.  Figure  3.3  shows  a  system  flow  chart  of  the 
Prescriptive  Garbage  Can  Model  process. 


Figure  3.3  System  Flow  Chart  of  PGCM. 


1.  User  Interaction 

a.  Define  the  problem  and  determine  the  organizational  states 

Once  we  define  the  problem  and  number  of  scale  points  for  each  factor,  we 
can  combinate  the  organizational  states.  We  shall  limit  the  number  of  scale  points  to 
P  =  3  (0,  0.5,  1.0),  S  =  3  (0,  0.5,  1.0),  E  =  2  (0,  1.0).  Thus,  if  we  take  into  account 

ail  the  combinations  of  (Pj  ,  Sj  ,  Ej),  we  can  have  at  most  18(3x3x2)  possible 

organizational  states.  Table  3  shows  the  description  and  the  organizational  states  of 
this  problem. 

b.  Identify  and  filter  all  the  conceivable  and  feasible  choices 

In  this  example,  we  choose  only  4  choices  towards  solving  the  offensive 
operation  problem.  They  are 

C(l)  :  Smoke  operation  and  do  attack 

Q2)  :  Supporting  high  performance  weapon  systems 

C(3)  :  Reinforcing  attack  forces 

C(4)  :  Changing  attack  forces 

For  instance,  (0.5,  0.5.  1.0)  is  one  of  these  combinations  denoted  in  our 

Table  3  by  Zjq.  It  can  correspond  to  a  situation  where  an  offensive  forces  have  a 

good  chance  to  attain  their  objectives  successfully  since  they  have  no  significant 
problems.  But  the  military  expert  may  have  some  questions  such  as  the  enemy's 
recovery  ability  from  the  previous  shock  or  friendly  forces's  risks  caused  by  a  little 
shortage  of  attack  forces,  etc.  So  the  military  expert  may  look  for  another  action  to 
protect  friendly  forces  such  as  a  smoke  operation.  A  smoke  operation  can  significantly 
reduce  the  enemy's  effectiveness  in  both  the  day  time  and  at  night.  Combined  with 
suppressive  fire,  smoke  will  provide  increased  opportunities  for  maneuver  forces  to 
deploy  while  minimizing  losses.  Also  the  effective  delivery  of  smoke  at  the  critical  time 
and  place  on  the  battle  field  will  contribute  significantly  to  the  combined  arms  team 
winning  the  first  battle.  Therefore,  we  we  choose  a  smoke  operation  as  one  of  feasible 
choices.  The  rest  of  the  choices  are  also  chosen  in  a  same  manner.  Generally  each 
state  may  have  a  different  set  of  feasible  choices  for  each  state.  For  example,  we  can 
pick  out  C(4)  since  is  an  ideal  state  we  don't  have  to  retain  on  C(4)  which  can  be 
selected  in  the  worst  situation,  so  Z^  has  3  choices.  Hereby,  we  bring  an  interface 
problem  between  PGCM  and  expert  system  that  identify  and  filter  all  the  conceivable 


TABLE  3 

DESCRIPTION  OF  PROBLEMS  AND  ORGANIZATIONAL  STATES 


Importance  of  problems  to  be  solved 
Degree  of  effectiveness  in  problem-solving 
Potential  energy  of  participants 

=0  No  significant  problem  regarding  attack  forces, 
mission  load,  weather,  relation  with  consequent 
military  operation 

=  . 5  Moderate  shortage  of  attacking  forces.  not  good 
weapon  system  good  weather,  a  certain  time  delay 
to  the  consequent  operation 

=1  Acute  shortage  of  attacking  forces,  big  mission 
load,  bad  weather*  a  tremendous  time  delay  to  the 
consequent  operation 

-0  Most  of  personnel  have  no  experience  in  the  battle 
field,  poor  coordination  with  adjacent  unit, 

§oor  performance  weapon  systems 
ome  ‘  personnel  have  an  experience  in  the  battle 
field,  appropriate  coordination  and  reasonable 
attack-defense  forces  ratio,  good  performance 
weapon  systems,  good  logistic  support  systems 
=1  Some  personnel  nave  an  experience  in  the  battle 
field,  excellent  coordination,  best  attack-defense 
forces  ratio,  excellent  performance  weapon  systems 
,  sufficient  logistic  support  systems 

=0  Not  quite  proud  of  their  operations , passive  action 
=1  High  morale,  high  responsibility 


State  Z. 


(P.^  ,  S^  ,  )  Remarks 


0.  0,0. 
0.  0,  0. 
0.  0,0. 
0.  0,0. 
0.  0,1. 
0.  0, 1. 
0.  5,0. 
0.  5,0. 
0.  5,0. 
0.5,0. 
0.  5,  1. 
0.  5,1. 
1.  0,0. 
1.  0,0. 
1.  0,0. 
1.  0,0. 
1.  0,1. 
1.  0,1. 


0,0.  o; 
o,  i.  o 
5,0.  0 
5,1.0 
0,0.  0 
0, 1. 0* 
0,0.  0 
0,1.0 
5,0.  o; 
5,1.0 
0,0.  0 
0,1.  0 
0,0.  0 
0,1.  0 
5,0.0 
5,1.0' 

0,0.  o; 

0,1.0 


ideal 


anti-ideal 


and  feasible  choices,  if  our  problem  has  hundreds  of  organizational  states.  That  system 
certainly  helps  all  experts.  For  the  simplicity,  this  example  has  all  the  same  number  of 
choices  for  each  state,  and  Appendix  D  shows  a  different  number  of  choices  for  each 


c.  Estimate  the  probabilities  using  expert  judgement 

Using  expert  judgement,  estimate  the  probabilities  ,  pj  c(k),  where  j  = 
1,2,  ...  ,  18  and  £j  £p[  ,  pj  c(k)  =  1.  Repeat  for  elements  S  and  E.  This  gives  £p-  .  pj 
c(k)  ,  and  gpj  ,  pj  c(k).  Given  P-  =  0  and  C(l),  Pj  may  transit  to  a  new  state  Pj  , 
where  Pj  can  be  0,  0.5  or  1.0.  By  examining  historical  data  and  gathering  advice  from 
senior  officers  or  military  experts,  assess  the  degree  of  influence  of  changing  attacking 
forces  on  P-  and  translate  the  assessment  into  matching  probabilities,  Pq  ,  q  C(l),  Pq  , 
qj  C(l),  Pq  ,  j  C(l),  with  which  each  of  these  three  transitions  can  take  place.  In  our 
Case,  These,probabilities  are  shown  below’. 

-pi  *  pj 

|  Initial  State  P-  =  0  Choice  C(l) 


Terminal  State 

Pj-0 

_ 

Pj  =  0.5 

Pj  =  1.0 

0.98  0.01  0.01 


The  values  shown  in  the  table  implies  that  if  there  are  no  major  problems 
regarding  offensive  operation  at  the  present  time  (since  Pj  =  0),  then  the  chances  are 
low  that  new  problems  might  occur  merely  on  account  of  changing  attacking  forces. 

We  now  consider  S-  ,  the  effectiveness  of  solutions.  Let  Sj  =  0  be  the 
initial  state  of  Sj.  Focus  on  the  same  choice  C(l).  As  before,  we  estimate  the  values  of 
Sq  ,  q  C(l),  Sq  ,  Q.j  C(l),  Sq  ,  j.Q  C(l).  Their  values  in  our  case  are  shown  below 

-pi  ’  pj 

Initial  State  S-  =  0  Choice  C(l) 

j  "  ' 

Terminal  State 

!  Sj  =  0  Sj  =  0.5  Sj  =  1.0 


0.97 


0.02 


0.01 


We  also  consider  E-  ,  the  potential  energy  of  participants  that  has  only  2 
scale  points.  Let  Ej  =  0  be  the  initial  state  of  Ej.  consider  on  the  same  choice  C(l). 
Their  values  in  our  case  are  shown  below 


2.  Transition  Probability  Matrix 

Use  formula  2.1  to  compute  the  row  of  the  transition  probability  matrix, 
C(l),  corresponding  to  state  Zj  and  choice  C(l).  In  this  step,  we  consider  all  the  three 
elements  discussed  above  together  to  generate  the  joint  transition  probabilities,  for  the 
initial  state  Zj  (0,0.0)  of  the  battle  field,  due  to  changing  attacking  forces.  Repeat  to 
generate  an  transition  matrix  for  the  remaining  17  states.  Table  4  shows  the  transition 
probability  matrix  of  Zj.  The  upper  part  of  this  table  is  an  application  of  formula  2.1 
in  connection  with  changing  attack  forces  and  the  lower  part  is  for  the  remaining 

choices.  C(2).  C(3),  and  C(4).  The  remaining  transition  probability  matrix.  Z-> . ZjS 

will  be  shown  in  Appendix  C. 

3.  Goodness  Measure 

The  goodness  measure  for  each  state  is  computed  using  formula  (2.2).  The 
resulting  g  values  for  our  example  are  given  in  Table  5.  As  shown  in  Table  5,  state 
represents  the  ideal  state  in  that  it  yields  the  highest  possible  benefit,  i.e.,  g=2. 
Conversely,  the  anti-ideal  state,  Zj-j  is  the  most  adverse  state  for  the  organization 
since  the  corresponding  benefit  is  the  lowest. 

4.  Transition  Benefit  Matrix 

Based  on  the  transition  probability  matrix  and  the  vector  of  goodness 
measure,  compute  the  transition  benefits  using  formulas  2.3  and  2.4.,  The  result  of 
performing  this  procedure  for  all  the  initial  states  is  shown  in  Table  6. 
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TABLE  4 

TRANSITION  PROBABILITIES  IN  Zj 

Computation  of  Transition  Probabilities  q^j  C(l) 
Initial  State: Z^_/ g  q  qj.  Choice  C( 1 ): Changing  forces 


ermma 


ormula 

2  S 


Transition  prob. 


1.  0,0. 
1.  0, 1. 
1.  0,1. 


0,0.  o; 
0,  1.  0 
5, 0.  0 
5,1.0' 
0,0.0' 
0,1.  o; 
0,0.0 
0,  1.  O' 
5,0.  O' 
5, 1.  O' 
0,0. O' 
0,1.0' 
0,0.  o; 
o,  1.  o 

5,0.  0 
5, 1.  0 
0,0.  O' 
0,1.0' 


0, . 0*. 
0, . 0*. 
0, . 0*. 
0, . 0*. 
0, . 0*. 
0, . 0*. 
0,  .  5*. 
0, . 5*. 
0, . 5*. 
0, . 5*. 
0, . 5*. 
0, . 5*. 
0,1.  *. 
0,1.  *. 
0,1.  *. 
0,  1.  *. 
0,1.  *. 
0,1.  *. 


0, . 0*. 
0, . 0*. 
0, . 5*. 
0, . 5*. 
0,  1.  *. 
0,1.  *. 
0, . 0*. 
0, . 0*. 
0, . 5*. 
0, . 5*. 
0,1.  *. 
0,1.  *. 
0, . 0*. 
0, . 0*. 
0, . 5*. 
0, . 5*. 
0,  1.  *. 
0,1.  *. 


0,  .  0 

0,  1. 
0,  .  0 

0,  1. 
0,  .  0 

0,1. 
0,  .  0 

0,1. 
0,  .  0 

0,1. 
0,  .  0 

0,1. 
0,  .  0 

0,1. 
0, .  0 
0,1. 
0,  .  0 

0,1. 


0.  98*0. 
0.  98*0. 
0.  98*0. 
0.  98*0. 
0.  98*0. 
0.  98*0. 
0.  01*0. 
0.  01*0. 
0.  01*0. 
0.  01*0. 
0.  01*0. 
0.  01*0. 
0.  01*0. 
0.  01*0. 
0.  01*0. 
0.  01*0. 
0.  01*0. 
0.  01*0. 


97*0. 95 
97*0.  05 
02*0. 95 
02*0. 05 
01*0. 95 
01*0. 05 
97*0. 95 
97*0. 05 
02*0. 95 
02*0. 05 
01*0. 95 
01*0. 05 
97*0. 95 
97*0. 05 
02*0. 95 
02*0. 05 
01*0. 95 
01*0. 05 


0. 903070 
0. 047530 
0.  018620 
0. 000980 
0. 009310 
0. 000490 
0. 009215 
0. 000485 
0. 000190 
0. 000010 
0. 000095 
0. 000005 
0. 009215 
0. 000485 
0. 000190 
0. 000010 
0. 000095 
0. 000005 


State  Z- 
state 


Transition  Probabilities  c(k) 

q^j  C(k)  for  j  =  1,  ...  ,  18;  k  = 

C(  1 )  -  - 


C(  2  ) 


C(  3  ) 


C(  4 ) 


TABLE  5 

EVALUATING  GOODNESS  MEASURES 


State  (Zi) 

(pi 

'  si 

'  Ei) 

9i 

1 

0.  0 

0.  0 

0.  0 

0.  0 

2 

0.  0 

0.  0 

1.  0 

1.  0 

3 

0.  0 

0.  5 

0.  0 

0.  5 

4 

0.  0 

0.  5 

1.  0 

1.  5 

5 

0.  0 

1.  0 

0.  0 

1.  0 

6 

0.  0 

1.  0 

1.  0 

2.  0 

7 

0.  5 

0.  0 

0.  0 

-0.  5 

8 

0.  5 

0.  0 

1.  0 

0.  5 

9 

0.  5 

0.  5 

0.  0 

0.  0 

10 

0.  5 

0.  5 

1.  0 

1.  0 

11 

0.  5 

1.  0 

0.  0 

0.  5 

12 

0.  5 

1.  0 

1.  0 

1.  5 

13 

1.  0 

0.  0 

0.  0 

-1.  0 

14 

1.  0 

0.  0 

1.  0 

0.  0 

15 

1.  0 

0.  5 

0.  0 

-0.  5 

16 

1.  0 

0.  5 

1.  0 

0.  5 

17 

1.  0 

1.  0 

0.  0 

0.  0 

18 

1.  0 

1.  0 

1.  0 

1.  0 

ideal 


anti-ideal 


TABLE  6 

TRANSITION  BENEFIT  MATRIX  OF  ALL  CHOICES 


State 

Zi 

Choices 

C(k) 

State 

C(  1) 

CT2T 

C(  3) 

1 

0. 055000 

1. 235000 

0. 340000 

0.  800000 

2 

-0. 005000 

0. 425000 

-0. 010000 

-0.  300000 

3 

0. 175000 

1. 180000 

0. 580000 

0.  400000 

4 

0. 115000 

0. 370000 

0.  23C000 

-0.  700000 

5 

0. 020000 

0. 770000 

0. 270000 

-0.  100000 

6 

-0. 040000 

-0. 040000 

-0. 080000 

-1.  200000 

7 

0. 160000 

1. 595000 

0. 750000 

1.  200000 

8 

0. 100000 

0. 785000 

0. 400000 

0.  100000 

9 

0. 280000 

1. 540000 

0. 990000 

0. 8000C0 

10 

0.  220000 

0. 73C000 

0. 640000 

-0.  300000 

11 

0. 125000 

1. 130000 

0. 680000 

0.  300000 

12 

0. 065000 

0. 320000 

0. 330000 

-0.  800000 

13 

0. 090000 

1.  600000 

1.  045000 

1.  700000 

14 

0. 030000 

0. 790000 

0. 695000 

0.  600000 

15 

0. 210000 

1. 545000 

1. 285000 

1.  300000 

16 

C. 150000 

0. 735000 

0. 935000 

0.  200000 

17 

0. 055000 

1. 135000 

0. 975000 

0.  800CC0 

19 

-0. 005000 

0. 325000 

0. 625000 

-0.  300000 

5.  Generate  the  long  run  choice  policy 

The  objective  of  this  step  is  to  determine  the  offensive  operation  policy  by 
evaluating  what  choices  result  in  highest  benefits  in  the  long  run  as  the  battle  field 
stochastically  transits  from  one  state  to  another.  The  mathematics  of  maximization  of 
the  long  run  benefit,  when  the  law  of  transition  shown  in  Table  4  and  benefit  function 
shown  in  Table  6  are  known,  can  be  achieved  using  Howard's  algorithm.  Let's  trace 
the  long  run  choice  policy  by  applying  formula  2.4. 
a.  Initialize  policy  table 

Select  best  choices  for  each  state  from  the  benefit  matrix  that  has 
maximum  value  among  C(l)  thru  C(5),  and  set  up  a  policy  table  as  the  following  table. 


b.  Resolve  variables  and  evaluate  max  property 

Once  we  have  resolved  all  the  variable  values  (v(l) . v(lS),  g)  using 

gaussian  elimination  method  [Ref.  S|  we  check  to  see  if  these  resolved  values  satisfy  the 
maximal  property  expressed  in  formula  2.4.  For  each  state-action  pair  S.a,  we  evaluate 
iiS.a)  -  g  Y  v(s)q$  ,  s  C(a)  and  then  for  each  state  S  choose  the  maximizing  act  "a" 
[Ref.  ”].  This  leads  to 

State  i(S,a)  V  v( s )q g  ,  s  C(a) 

(1.1)  0.055-g  +  0.903070v(  1 )  +  0.047530v(2)  ..  =  1.00E  +  00-g 

(1.2)  1  •  235-g  +  0.039 200v(  1 )  +  0. 1 56SOOv(  2)  ..  =  1.00E  +  00  -  g* 

(1.3)  0. 340- g  +  0. 6 1 7400v(  1 )  +  0. 264600v(  2 )  . .  »  1 .0UE  +  00  -  g 

(1.4)  0.800-g  +  0.01 8000v(  1 )  +  0.072000v( 2 )  ..  -1.00E  +  00-g 


(10.1 )  0.220-g  —  0.0000  1 9v(  2 )  0.00 1 8S 1  v(  3 )  ..  =  -6.25E- 16  -  g* 

(10.2)  0."'0-g*0.0()00^0v(2)^0.0069?0v(3)  ..  =  -1.50E-15  -  g 


(10.3)  0.640-g  +■  0.000400v(2)  +  0.007600v(3) ..  =  -1.62E-15  -  g 

(10.4)  -0.300-g  +  0.006000v(2)  +  0.C  14000v( 3)  ..  =  -8.60E-16  -  g 


c.  Set  a  new  policy  table 

At  the  above  step,  we  observed  a  new  policy,  marked  by  the  asterisks  and 

they  are 


I  New  Choice  Policv  Table 

i _  _  _  _  .  _ 

;  S1S2S3. 

.  S7  S8  S9  S10  .  .  .  S 1 5  S16  S 1 7  SIS 

|  242.. 

' — - - — — ! 

.  2  2  2  1  ...  2  3  2  1 

J 

d.  Compare  a  new  policy  table  with  a  previous  one 

Repeat  b)  and  c)  until  a  new  policy  table  and  a  previous  policy  table 
correspond  each  other  or  the  maximal  income  per  unit  time  (g)  is  decreased.  The  latter 
case  .occasionally  happens,  and  is  possible  in  the  case  of  g  value  near  zero.  For  this 
unstable  state,  we  set  recursively  arbitary  equal  to  0,  and  repeat  a)  thru  c). 

e.  Test  result 

As  a  result  of  prescriptive  garbage  can  model  execution,  we  lay  down  a 
policy  table  shown  in  Table  7  that  have  solved  expressed  by  formula  2.5.  Given  Table 
7  recommend  and  advise  the  commander  of  the  best  choices  available  in  a  specific 
organizational  state.  For  example,  if  given  situations  are  (i)  Acute  shortage  of 
attacking  forces,  big  mission  load,  a  tremendous  time  delay  to  the  consequent 
operation,  (ii)  Most  of  personnel  have  no  experience  in  the  battle  field,  poor 
coordination  with  adjacent,  poor  performance  weapon  systems,  (iii)  Not  quite  proud  of 
their  operations,  we  would  like  to  change  attack  forces  known  as  choice  4  to  achieve 
his  goal.  Like  this  we  can  select  choice  1  (do  smoke  operation)  in  state  6,10,18,  choice 
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2  (supporting  high  performance  weapon  systems)  in  state  1,3,4,7,8,9,11,14,15,17,  choice 

3  (reinforcing  attack  forces)  in  state  12,16,  and  choice  4(changing  attack  forces)  in  state 
2,5,13. 


I 

I 


TABLE  7 

SELECTED  CHOICE  POLICIES 


IV.  FURTHER  RECOMMENDED  STUDIES 


This  thesis  considers  a  prescriptive  garbage  can  model  to  advise  the  participants 
of  the  choices  available  to  them  in  a  specific  organizational  state,  and  implements  it  to 
generate  a  choice  policy  table.  The  current  system  covers  chance  events  resulting  from 
the  interactions  of  four  elements  in  the  organizational  context,  (i)  problems,  (ii) 
solutions,  (iii)  participants,  and  (iv)  choice  opportunities.  The  computer  program  could 
be  modified  to  process  a  greater  number  of  organizational  states  depend  on  a  memory 
allocation! current  system  maxchoice  5,  maxstate  36). 

An  ideal  PGCM  wouid  be  one  that  interfaces  with  an  expert  system  to 
automatically  transfer  estimation  probabilities  and  feasible  actions  about  the 
organization  problem  into  PGCM  system  without  human  intervention.  The  following 
diagrarr  shows  how  an  expert  system  would  be  used. 


Interface  between  Expert  System  and  PGCM 


An  expert  system  uses  methods  of  reasoning  to  eliminate  bad  courses  of  actions 
and  to  determine  the  best  courses  of  actions  to  achieve  a  goal.  Expert  systems  use 
information  in  an  intelligent  way  to  perform  tasks  that  are  normally  associated  with 


human  experts.  There  are  many  anarchic  and  random  situations,  but  human  experts 
have  some  difficulties  to  find  the  best  choice  every  time.  Hereby  we  illustrated  a 
diagram  as  one  possible  model  to  interface  between  PGCM  system  and  expert  system 
to  determine  the  best  actions  for  the  given  set  of  organizational  states.  The  next  step 
in  this  study  is  how  to  interface  an  expert  system  to  estimate  transition  probabilities 
and  feasible  actions  for  input  to  the  prescriptive  garbage  can  model. 
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APPENDIX  A 
A  SOURCE  PROGRAM 


PROGRAM  PGCMPROG( Input,  Output); 

(*$s  400000  *) 

(  ******** XX* ***********  -kb* ********** ******* **************** 


** 
** 
** 
*  * 
** 
** 
** 
** 
** 
** 
** 
** 
** 


TITLE 

AUTHOR 

Date  Written 

Product 
System  Used 

I/O  Process 

Description 


PRESCRIPTIVE  GARBAGE  CAN  MODEL 
Mai  Kang,  Sun  Mo 
11  Feb  -  19  May  37 

Version  1. 

IBM  3033  VM/CMS 

Terminal  Keyboard 

This  program  is  an  interactive 
choice  processing  system  to  support 
decision  making  by  using  Prescriptive 


** 

** 

** 

** 

** 

** 

** 

** 

** 

** 

** 

** 

** 


Garbage  Can  Model 
**********************************************************  > 


(**  Global  Constants  **) 
const 


type 


zero  =  0; 

one  =  1 ; 

two  =  2 ; 

three  =  3; 

four  =  4; 

SIX  =  6; 

eight  =  8; 

ten  =  10; 

seventy  =  70; 

*  number  of  variable 

*  number  of  maximum  choice  for  each  state 

*  number  of  maximum  scale  point  for  one  factor 

*  number  of  maximum  states 

*  number  of  maximum  states  plus  one 

*  number  of  maxsrows,  max-state*choice 


maxfactor  =  3; 
maxchoice  =  5; 
maxscales  =  5; 
maxstate  =  36; 
maxstateetc=37 ; 
maxrow  =  180; 


counter  =  0..maxint; 

inputtype  =  record 

line  :  array( .one .. seventy. )  of  char; 
length  :  counter; 

last  :  counter; 


end; 

commands  =  (EXECGCM,  EXECEXIT,  BAD); 

usermsgs  =  (BADLINE ,  N0INPUT,  NOINTERACT,  ETCVAL ,  ETCCHO, 
N0NNUM,  OVERSTATE,  IMPOSSIBLE); 
choicetable  =  array( .one . .maxstate . )  of  integer; 
transitiontable=array( .one . .maxrow,  one . .maxstate . )  of 
benefittable  =  arrayi .one. .maxstate,  one. .maxchoice. )  of 
policytable  =  array( .one . .maxstate . )  of  integer; 


real; 
real  ; 


(**  Global  Variables  **) 
var 

possiblestates , 
mt,  vi  :  integer; 

gain  :  real; 

wait  :  char; 

choices  :  choicetable; 
tranmatrix:  trans itiontable ; 
benematrix:  benefittable,- 


policy  :  policytable; 

userinp  :  inputtype,- 

command  :  commands ; 

helpfile  :  text; 

quitnow, 

goodvalue  :  boolean; 


I*  ##########################################  *) 
*  ###  ###  * 

*  ###  G  C  M  PART  I.  ###  * 

*  ###  Functions  ###  * 

##########################################  * 
n— —~=— zz—~~=— A  S 

===  Function  Getinp  ===  *' 


Function  getinp(var  userinp  :  inputtype) tboolean; 

(*  Get  a  single-letter  command, 

making  sure  it  is  in  the  set  of  valid  commands  *) 

var 

ch  :  char; 
begin 

userinp. length  :=  0; 
userinp.  last  -.=  0; 
if  eof  then  getinp  :=  false 
else  begin 

while  not  eoln  do  begin 
read(ch) ; 

if  userinp. length  <  seventy  then  begin 

userinp. length  :=  userinp . length  +  1; 
userinp . line ( .userinp. length. ;  :=  ch.- 

end 

end,- 

readln; 

getinp  -.=  true; 

end; 

end;  (*getinp  *) 


A 

A 

A 


Function  Skipblanks 


A 

A 

A 


Function  skipblanks (var  userinp  :  inputtype) :boolean; 
var 

blank  :  boolean; 
begin 

blank  :=  true; 

while  (userinp. last  <  userinp . length)  and  blank  do  begin 
userinp. last  :=  userinp. last  +  1; 
if  userinp. line ( .userinp. last . )  <>  1  1  then 
blank  false 

end; 

if  not  blank  then 

userinp. last  :=  userinp. last  -  1; 
skipblanks  :=  blank; 
end;  (*  skipblanks  *) 


/*  ==========================================  *) 

(*  ===  Procedure  Getchar  ===  *) 

/*  ==========================================  *) 

Erocedure  getchar  (var  userinp .-  inputtype ;  var  chichar); 
egin 

if  userinp. last  <  userinp. length  then  begin 
userinp. last  :=  userinp. last  +  1; 
ch  :=  userinp. line( .userinp. last. ) ; 
end  else 
ch  :=  1  1  ; 
end;  (*  get  char  *) 


Procedure  Writeuser 


procedure  writeuser (msg :usermsgs) ; 
begin 

case  msg  of 
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V 


BADLINE 
NOINPUT 
NO INTERACT 
NONNUM 
ETCVAL 


ETCCHO 


OVERSTATE 


IMPOSSIBLE: 


writelru'Bad  Input,  try  again 
writelnt 1  Have  no  data,  try  again 
writelnt 1  Nothing  typed,  try  again 


<press  enter  key> 1 
<press  enter  key>' 
<press  enter  key> 1 


2  to  9,  try  again 


end; 

readln(wait)  ; 
end; 


writelnt ' Nothing  typed,  try  again  <press  enter  xey> 
writelnt 'Nonnumeric  data,  try  again  <press  enter  key> 
begin 

write  ('Available  scale  point  :  2  to  9,  try  aga; 
writelnt  '<press  enter  key>'),- 
end; 
begin 

write  ('Available  choice  :  2  to  5,  try  again 
writelnt ' <press  enter  key> 1 ) ; 
end; 
begin 

write  ('Maximum  organizational  states  is  less  ' 
writelnt 1  than  36,  try  again  <press  enter  key> ' 
end; 
begin 

write  ('Cannot  set  up,  try  again  with  new  data 
writelnt 1 <press  enter  key>1 ) ; 
end; 


than  36,  try  again  <press  enter  key> ' 


'<press  enter  keyv  ) ; 


/**********************************************\ 
>*****  Function  Getcommand  *****) 

Function  getcommand(var  command; commands) :boolean; 
(*  Get  a  single-letter  command, 

make  sure  it  is  in  the  set  of  valid  commands  * 

var 

ch  :  char; 
userinp:  inputtype; 

begin 


1.  ExecGCM  (Execute  GCM  Program 

2.  ExecExit(Execution  stop 


l  ***  >  y- 

*  ************* 


writeln( 1  ****************************************************** 1 
vritelru  1  ***f 

writelnt1*^*  GCM  Program  Options  are  the  followings  *'r*1 

writeln(  1  *** -  **1'1 

writelnt 1 *** 
writelnt 1 *** 

writelnt'***  1.  ExecGCM  (Execute  GCM  Pr 
writelnt 1 *** 

writelnt'***  2.  ExecExit(Execution  stop 
writelnt ' *** 

writelnt1***  =====>  Type.  Number  !!!! 
writelnt * ******************************* 
getcommand  :=  false; 
command  :=  BAD; 
if  getinp(usennp)  then  begin 
getcommand  ;=  true; 

if  not  skipblanks(userinp)  then  begin 
getchar (userinp , ch) ; 
if  skipblanks(userinp)  then 
if  ch  in  ( .  1 1  ’  ,  1  2  1  . )  then 
case  ch  of 

'l1  :  command  :=  EXECGCM  ; 

'2'  :  command  :=  EXECEXIT; 
end 

else  getcommand  :=  false; 

end; 
end; 
end; 


ype ,  Number  !!!!  ***' 

*****************************************  1 


V 
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(*  ##########################################  *) 

(*  ###  G  C  M  PART  II.  ###  * 
(*  ###  Generate  Matrix  ###  *) 
(*  ###  ft##  *) 
(*  #$#  generate  transition  probability,  £##  *) 
(x  #tt#  transition  benefit  probability,  ###  *) 
{*  ###  organizational  states,  goodness  ###  *) 
{*  ###  measure  table:  Input  for  Part  III  ###  *) 
(*  *####################&####################  *) 


(*****  get  transition,  benefit  MATRIX  *****) 

Procedure  Getmatrix(var  possiblestates  :  integer ;  var  choices  :choicetable 
var  tranmatrix : transitiontable ;  var  benematrix :benef ittable ) 

const 

maxirow  =  45; 

type 

scaletable  =  array  ( . one . .maxfactor . )  of  integer: 
scalevaltable  =  array  (. one . .maxscales ,  one . .maxscaies . )  of  real; 

estimationtable=array ( .one. .maxfactor , one . .maxirow, one. .maxscales. ) 

of  real; 

combination  =  record 

column  :  array  (. one . .maxfactor . )  of  real; 
end; 

statematrix  =  array  ( .one. .maxstate. )  of  combination; 

goodnessmatrix  =  array  ( .one. .maxstate.)  of  real; 

var 

numfactor , 

maxcho  :  integer; 

scales  :  scaletable; 

scalevals  :  scalevaltable; 

statmatrix  :  statematrix; 

goodmatrix  :  goodnessmatrix; 

estmatrix  :  estimationtable ; 


f-k  kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk 

(*  **x  Ge t  Number  of  Factors  ***  *) 

Procedure  getnumoffactor (var  numfactor :  integer 

var  possiblestates :integer; 
var  scales :scaletable) ; 

var 


i  :  integer; 

ch  :  char,- 

indomain  :  boolean; 


*  ===  Function  Get  Max  #  of  States  ===  * 


Function  Getmaxnum(num  :  integer;  scales  :  scaletable)  :integer,- 
var 

base,  i  :  integer; 
begin 

base  :=  one,- 
for  i  :=  1  to  num  do 
base  :=  base  *  scales (. i .)  ; 
getmaxnum  :=  base,- 

end; 


begin 

wr ite In (' Number  of  factors  :  3  --  P,  S,  E1); 

writeln(  1 _ '  )  ; 

writeln,- 
numfactor  :=  3; 

writeln(  1  Enter  #  of  scale  points  for  each  factor 
wrtteln(  ' _ 


writeln; 

^ **********  get  number  of  scale  point  **************) 
mdomain  :=  false; 
repeat  (*repeat  1*) 
i  ;  =  1 ; 

repeat  (*repeat  2*) 
goodvalue  :=  false; 


writeln( 1  factor 1 , i 


2,  • 

then 


if  getinp(userinp) 
begin 

if  not  skipblanks(userinp) 
begin 

getchar (userinp , ch) ; 
if  skipblanks (userinp) 


then 


then 
4' , 1 5' 


8 '  ,  1 9 1  . )  then 


'2'  :  int  :=  2; 

'3'  :  int  :=  3; 

'4'  :  int  :=  4; 

1 5 1  :  int  :=  5; 

'6'  :  int  :=  6; 

'7'  :  int  :=  7; 

'8'  :  int  ;=  8; 

'9'  :  int  :=  9; 

end;  (*caseend*) 
goodvalue  :=  true; 
end  (*endif  ch*) 

else  writeuser (ETCVAL)  (*else  ch*) 
else  writeuser (ETCVAL)  (*else  shipblanks*) 
end  (*endif  notskipblanks*) 

else  writeuser (NOInPUT)  (*else  notskipblanks*) 
end  (*endif  getinp*) 

else  writeuser (NOINTERACT) ;  (*else  getinp*) 

if  goodvalue  then 
begin 

scales( . i. )  :=  int; 
i  :=  i  +  1; 
end 

until  (i  =  numfactor+one) ;  (*end  repeat2  *) 

(**********  check  and  correct  scale  point  **********) 
repeat  (*repeat3*) 

writeln('#  of  scale  points  are  :  '); 
for  i  :=  one  to  numfactor  do 

writeln( 1  factor i  -.2 ,  1  :  '  ,scales(  .i. ) ) ; 
writeln( 1 goahead  :  Press  any  key,  correction 
writeln;  writeln; 
readln(ch) ; 

if  ch  =  then  begin 

writeln( 1  Enter  factor  number  and  value  :  ') 
readln(i,  scales (. i. )) ;  end; 
until  not(ch  =  '%');  (*end  repeat3*) 

possiblestates  :=  qetmaxnum(numfactor ,  scales); 
indomain  t-  (possiblestates  <=  36); 
if  not  indomam  then  writeuser  (OVERSTATE)  ; 
until  indomain;  (*end  repeat  1*) 
end; 


-k-k’k’k'k'k’k-k’k  -k'k-k'k-k-k-k'k'k'kirk'k-k’k'k'k^-k  *+ek-k*'k‘k-k-k*'kirk‘k 

)*  ***  Get  Number  of  Choices  ***  *) 

/  -k  TK-kirk'k^-k-k-k^rk-kirk-k'k-k-k^rk-k'k-k-k^'k'kyr'kiK-k-k'k-k-k-k'k'k'kirk-k 

Procedure  getnumofchoices (numfactor : integer;  possiblestates : integer ; 

var  choices :choicetable ;  var  maxcho : integer) ■ 

var 

i  :  integer; 

ch  :  char; 

begin 
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write  ('Get  Number  of  Choices  for  each  State  Z(i) 
writelnt'i  =  1  . .  1 ,possiblestates :3) ; 

write  (’ _  _ _ _ 

writeln(  1  1  )  ;  wnteln; 

^**********  number  of  choice  ***** 

1  :=  1; 
repeat 

goodvalue  :=  false; 
writeln( ' State  1 , i  :3 ,  1  :  '); 
if  getinp(userinp)  then 
begin 

if  not  skipblanks (userinp)  then 
begin 

getchar (userinp .  ch) 
if  skipblanks (userinp)  then 
if  ch  in  ( . ‘ 2 1 , 1 3 1 , 1 4 ' , 1 5 
begin 

case  ch  of 

'2'  :  int  :=  2; 

'3'  :  int  :=  3; 

'4'  :  int  :=  4; 

'5'  :  int  :=  5; 


**************> 


)  then 


'2'  :  int  ;=  2; 

'3'  :  int  :=  3; 

'4'  :  int  :=  4; 

'5'  :  int  :=  5; 

end;  (*caseend*) 
goodvalue  :=  true; 
end  (*endif  ch*) 

else  writeuser (ETCCHO)  (*else  ch*) 
else  writeuser (ETCCHO)  (*else  shipblanks*) 
end  (*endif  notskipblanks*; 

else  writeuser (NOINPUT)  (*else  notskipblanks*) 
end  (*endif  getinp*) 

else  writeuser (MOINTERACT) ;  (*else  getinp*) 

if  goodvalue  then 
begin 

choices( .i. )  :=  int; 
i  i  +  1  ; 
end 

until  (i  =  possiblestates+one)  ,•  (*end  repeat2  *) 

(kkkkkkkkkk  chGCk  cind  COTTCCt  k  kk  kkkkkk  k  k  k  ^ 

writeln( ' State  Z(i)  #  of  choices'); 

writeln(  1 _  _ '); 

repeat 

for  i  :=  one  to  possiblestates  do 
writeln(i:6,  choices (. i .): 20 ) ; 
writeln( 1 goahead  :  Press  any  key,  correction  :  "%" ' ) 
writeln;  writeln; 
readln(ch) ; 

if  ch  =  then  begin 

writeln( ' Enter  state  number  and  value  :  '); 
readln(i,  choices (. l .)) ;  end; 
until  not(ch  =  ' %' ) ; 
maxcho  :=  -999 ; 

for  i  :=  one  to  possiblestates  do 

if  choices(.i.)  >  maxcho  then  maxcho  :=  chcices(.i.) 


fk  kkkkkkk'h'k'k'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk  k 

>*  ***  Estimate  Probability  *K*  * 

'  k  kkkkkkk'k’kkk'kkkkkkkkkkkkkkkkkk^kkkkkkkkkkkk  k 


Procedure  getestprob(numfactor : integer ;  maxcho : integer; 

scales  :  scaletable ;  var  scalevals : scalevaltable 
var  estmatrix : estimationtable )  ,- 


i, j ,k,l,m,n 


integer ; 
real; 
char  ; 


Get  scale  points  of  each  factor 


:-n 

K- 

ft 

i 

I 

p 

s: 

I 


* 

jf 


» 

s; 

£ 

r«  - 

i 

$ 

•v> 

* 
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Procedure  Getvalof scale (num: integer;  var  scalevals :scalevaltable) ; 
var 

i,j,k  :  integer; 

.  P  :  real; 

begin 

for  i  :=  1  to  num  do 

for  j  :=  1  to  scales(.i.)  do  begin 
P  :=  ( j”l)/ (scales ( . i.)-l) ; 
k  :=  round(p  *  100); 
scalevals( .1, j . )  :=  k/100; 

end; 

end; 

begin 

getvalof scale (numf actor , scalevals ) ; 

(**********  (jet  estimation  probability  ************) 
writeln('Get  Estimation  Probabilities''); 

writeln ( ' _ 1  )  ; 

writeln; 

for  i  :=  one  to  maxcho  do 

for  j  :=  one  to  numfactor  do 


do 


=  '); 


-isl. 


begin 

writeln( ' (factor ' ,j  :1 ,  1  )') : 
for  k  :=  one  to  scales(.j.) 
begin 

write  ('Initial  State  f ( 1 , j : 1 , 1 )  = 
writeln(scalevals( .  j  ,k. )  :6.-2,  '  Cnoice  C( 
writeln( 1  Terminal  State  :  '); 
for  1  one  to  scales(.j.)  do 

write  ('  prob',l:l,'  ');  writeln; 

/*****  reacj  estimation  probability  *****) 
for  1  :=  one  to  scales(.j.)  do 

read  (estmatrix( . j , (i-l)*scales( . j . )+l,k. ) ) ; 
readln; 

end;  (*end  k*)  writeln;  writeln; 

^**********  check  and  correct  **************) 
repeat 

write( '  '  :  10 ) ; 

for  k  :=  one  to  scales(.j.)  do 

write  (' - ');  writeln; 

write('  1  : 1 0 ) ; 

for  k  :=  one  to  scales(.j.)  do 

write  (scalevals ( .j ,k. ) :6 :2 ,  '  ');  writeln; 
write( '  '  :10)  ; 

for  k  :=  one  to  scales(.j.)  do 

write  (' - ' )  ;writeln.- 

for  k  :=  one  to  scales(.j.)  do 
begin 

write( '  ' :5 , i  :1 , 1  1  :4)  ; 

for  1  :=  one  to  scales(.j.)  do 

write  (estmatrix( .  j  ,  (i-1  )* scales ( .  j  .  )+k,  1. )  -.6  :2 ,  1 
writeln; 

end;  (*end  k*)  writeln; 

writeln( ' goahead  :  Press  any  key,  correction  :  "%" ' ) 
writeln;  writeln; 
readln(ch) ; 

if  ch  =  then  begin 

writeln( '  Enter  Choice,  row,  col,  prob  :  '),- 
readln(k,  1,  m,  p); 

estmatrix( . j , (k-l)*scales( . j . )+l,m. )  :=  p;  end; 
until  not(ch  = 

end;  (*end  j*) 


end; 


*  rs::s::=s==::==::sz=::ss======s=======:==s  * ' 

!*  ===  Procedure  Get  State  Matrix  ===  * 
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procedure  Ge ts ta tmatrix(numfac tor :  integer ;  possibles tates  :  integer 

scales : sc ale  table ,-  sea leva Is : scaleval table ; 
var  statmatrixistatematrix) ; 

var 

i.  j,  K, 

ptr,  loop,  mult  :  integer; 
begin 

nult  :=  one; 

for  i  :=  one  to  numfactor  do 
begin 

mult  :=  mult  *  scales(.i.); 
loop  :=  possiblestates  div  mult; 
ptr'  :  =  0  ; 

for  j  :=  one  to  mult  do 
begin 

ptr  :=ptr+  one; 

if  ptr  >  scales(.i.)  then  ptr  :=  (ptr  mod  scales (. i .)) ; 
for  k  :=  one  to  loop  do 

statmatnx( .  ( j-l)*loop+k.  ) . column ( .  i. )  :=scalevals( .  i,ptr.  ) 

end; 


'  *  - — 
>*  === 


j*  ===  Procedure  Print  State  Matrix  === 

procedure  printstatmatrix(numfactor :integer;  possiblestates :integer  ,- 

statmatnx-.statematrix) ; 

var 

colptr , 

scaleptr,  tableptr  :  integer; 

begin 

page ; 

wnteln( 1 _ _ _ 1  •■$7); 

writeln( 1  Organizational  States  1  :57)  ; 

writeln( 1  _ 1  : 57 )  : 

writeln;  write  In; 

writeln( 1 _ .  _  .  _ _ :70)  ; 

writelni ' Humber  of  factors i rT49,  numfactor  :  1); 
writelni'  State  Combinations  of  Scale  Values' : 67 ) ; 

writeln (  ' _  _ _ '  s 70 )  ; 

for  tableptr ;=  one  to  possiblestates  do 
begin 

vrite('  1  : 2  3 ) ;  write( tableptr :6) ;  write('  1 : 9 ) ; 
for  Colptr  :=  one  to  numfactor  do 

write(  statmatrix( .  tableptr .)  .column(  .colptr . )  :  6:2,  '  1  -.2 
writeln; 
end; 

writeln(  '  _ 1  : 7 0 )  ; 


|*  ===  Procedure  State  Matrix  for  Help  ===  *| 

procedure  printhelpf ile( numfactor : integer;  possiblestates : integer ; 

statmatnx :  statematrix)  ; 

var 

colptr, 

scaleptr,  tableptr  :  integer,- 
begin 
page 

rewrite (helpfile ,  'helpfile  data1); 

writeln(helpfile ,  'Organizational  States1 :38); 
writelm  helpfile  .  1  _________  1  ;38) ; 

writeln( helpfile) ;  writeln(helpfile) ; 

write  (helpfile,  1 _ ') 
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writeln(helpfile,  1 _  1  ),- 

for  tableptr  :=  one  to  possiblestates  do 
begin 

write(helpfile ,  tableptr  -.6)  ; 
write(helpfile,  1  1  :9); 
for  Colptr  :=  one  to  numfactor  do 
write (nelp file , statmatrix( . tableptr. ) . column ( .colptr .) :6 : 2) ; 
writeln(helpfile ,  '  ':2); 
end; 

write  (helpfile,  1 _ _ '); 

writeln(helpfile ,  '  '  ) ; 


Procedure  Transition  Matrix 


procedure  gettranmatrix( numfactor : integer ;  possiblestates :  integer ,- 

choices  :choicetable ;  scales  :scaletable,- 


scalevals :  scaleval  table 
estmatrix :estimationtabie ; 
statmatrix :  statematrix: 
var  tranmatrix:transitiontable) ; 


begin 


init,  next 
cho,  columns, 

pointer,  firstptr,  secondptr 
getprob,  multiprob  :  real; 
found  :  boolean; 


integer ; 


for  init  :  =  one  to  possiblestates  do 
for  cho  :=  one  to  choices (. init . ) 
for  next  :=  one  to  possiblestate: 


(*  loopl  *) 
do  (*  loop2  *) 
do  (*  loop3  *) 


for  next  :=  one  to  possiblestates  do  (*  Ioop3  *) 
begin 

multiprob :=  1; 

for  columns  -.=  one  to  numfactor  do  (*  loop4  *) 

begin 

pointer  :=  0; 

firstptr  :=  0;  secondptr  :=  0; 
found  :=  false; 

While  not  found  do 
begin 

pointer  :=  pointer  +  1; 
if  scalevals( . columns .pointer . )  = 

statmatrix( . init . ) .column( .columns . )  then 
firstptr  :=  pointer; 
if  scalevals (. columns .pointer . )  = 

statmatrix( .next . ) . column ( .columns . )  then 
secondptr  :=  pointer,- 
found  :=  not  ( (firstptr*secondptr)=0) 


found  :=  not  ( (firstptr*secondptr)=0) 
end.- 

secondptr  :=  vcho-l  )*scales(  .columns  . )+  secondptr,- 
getprob  :=  estmatrix( .columns , secondptr , firstptr .) ; 
multiprob  :=  multiprob  *  getprob; 
end; 

(*  end  of  loop4  *) 

tranmatrix( . ( init-1 )*choices ( .init. )+cho, next. )  :=  multiprob; 
end.- 

(*  end  of  loop3  *) 

(*  end  of  loop2  *) 

(*  end  of  loopl  *) 


(*  ==  PROCEDURE  PRINT 


Transition  Matrix  ==  * 
=====================  * 
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procedure  print tranmatrix (possible states : integer;  choices : choice  table ; 

tranmatrix : transitiontable) ; 

var 

columns , 

init,  next  :  integer; 

temparray  :  array  (.1..5.)  of  real; 

begin 

for  init  :=  one  to  possiblestates  do  (*  loopl  *) 
begin 
page  ; 

wntelnj  1  _ '  -.47)  ; 

writelm ' Transition  Matrix1 :47>; 

writein(' _ 1  :47); 

writeln; 
writeln ; 

writeln(  1  Initial  State  ••  Z',init:3); 

write  _ _ 

writelm '  '  )  ; 

write  ( 1  state 


write  ( 1  state  '  )  ; 

for  columns  :=  one  to  choices( .init. )  do 
write ( ' C( ' , columns :1 , ' )  '  ,  1  1  : 1 0 )  ; 
writeln; 

write  (' _ 

writeln( '  1  ) : 


(*  erase  *) 
for  columns 


for  columns  :=  one  to  choices (. init . )  do 
temparray ( . columns . )  :=  0; 

for  next  :=  one  to  possiblestates  do  (*  loop2  *) 
begin 

write(next :4)  ; 

for  columns  :=  one  to  choices (. init . )  do  begin  (*  loop3  *) 
write (tranmatrix( . (init-l)*choices( .init.;+columns,  next. ) : 

(*  erase  *) 

temparray (. columns . )  :=  temparray (. columns . )  + 

tranmatrix ( . (init-1 )*choices( . init. )+columns ,  next . ) 
end;  {*  erase  *) 

(*  end  of  loop3  *) 
writeln; 
end- 

(*  end  of  loop2  *) 

,  T  V-  4-  ^  /  I _ ‘  - _  _  ' 


Procedure  Do  Goodness  Measure 


procedure  Goodnessmeasure(numf actor : integer ;  possiblestates : integer 

statmatrix:statematrix; 
var  goodmatrix : goodnessmatrix) ; 

var 

index, 

ideal,  anti  -.  integer; 


Procedure  Print  Goodness  Matrix 


procedure  printgoodmatnx 
const 


two  =  2 
four=  4 
eight=8 

var 


loop, 

row,  col  :  integer,- 

begin 


page ; 

wnteln 

writeln 

writeln 

writeln 


writeln 

write 

writeln 


write 

wnteln 


/ 

I 

i 


Goodness  Measurements 


State  Combination  '); 

1  : (numfactor-two)*eight+four ,  'Goodness  Remarks' 


write  ('  Z(i)  1 ) ; 

for  loop  :=  one  to  numfactor  do 

write! 1 val ' , loop : 1 , '  1  1 4 )  ;  writeln( ' value ') ; 

write  (' _ _ 1  ) ; 

writeln( 1  '  ) : 

for  row  -.=  one  to  possiblestates  do 
begin 

write(row:6) ; 
write! 1  '  :9) ,- 

for  Col  :=  one  to  numfactor  do 

write!  statmatrix! .row. ) -column! .col. )  :  6:2,  '  1 : 2 ) ; 

write^goodmatnx! .  row. )  :  6:2,  '  '  :2)  ; 
if  row  =  ideal  then  write!'  1  :5,  'ideal') 

else  if  row  =  anti  then  write!'  ' i 5 ,  'anti-ideal'),- 
writeln; 
end; 

writeln! ' _ 

end; 


); 


(**  Procedure  Begin  **) 
begin 

max  :=  -999;  min  :=  999; 
for  index  :=  one  to  possiblestates  do 
begin 

Case  numfactor  of 

2  :  writeln!'*  Not  Drepared  *'),- 

3  :  begin 

temp  :=  -(statmatrix( .index. ) .column! .one. ) ) 

+(statmatrix( . index. ) . column! . two. ) ) 

+( statmatrix! . index. ) . column! . three . ) ) • 
goodmatrix! . index. )  :=  temp; 
if  temp  >  max  then 
begin 

max  :=  temp;  ideal  :=  index,- 
end; 

if  temp  <  min  then 
begin 

min  :=  temp;  anti  :=  index,- 
end  ; 

end; 

4  :  writeln!'*  Not  prepared  *'),- 
end:  (*  end  case  *) 

end;  (*  end  for  *) 

Prmtgoodmatrix; 

end; 


( *  ====r=========================r:============  * 

!*  ==  Procedure  Get  Benfit  Matrix  ==  * 

/  k  —  —  —  —  —  —  —  —  —  —  —  —  =  =  — —  k 

v 

procedure  getbenematrix(possiblestates : integer ; 
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P? 


r 


’  A 


**  n  *  «  '  «  *  «  *•  -  * 


choices :choicetable ,- 
tranmatrix: transitiontable ; 
goodmatrix-.goodnessmatrix,- 
var  benematrix:benefittable) ; 


begin 


row,  col,  loop  :  integer,- 
temp  :  real; 


for  row  :=  one  to  possiblestates  do  (*  loopl  *) 
for  col  :=  one  to  choices (. row. )  do  (*  1< 
begin 

temp  -.=  0 ,- 

for  loop  :=  one  to  possiblestates  do  (* 


(*  loop2  *) 

(*  loop3  *) 


temp  :=  temp+( tranmatrix( . (row-l)*choices( .row, )+col, loop. ) 

*(qoodmatrix(  .loop. )  -  goodmatnx( .  row.  ) ))  ; 

’  .  5  :  =  temp  ,- 


benematrix( . row  col 
(*  end  of  loop3  *) 
end; 

(*  end  of  loop2  *) 

(*  end  of  loopl  *) 


[*  ==  Procedure  Print  Benefit  Matrix  ==  * 


procedure  printbenematrix(possiblestates  :  integer ;  maxcho :  integer  ,- 

choices  .-choicetable ;  benematrix:benefittable) 


latnx1 


=  10); 


var 

row,  col  :  integer,- 

begin 
page ; 

write  In  ( 1 _  _ 1  :47  ) ; 

write  In ( 1 Eenefit  Matrix1  :47); 

wnteln( ' _ 1  ;47)  ,- 

wnteln,- 
write  In; 

write  (  1  State  2(  i)  '  )  ,- 
for  col  :=  one  to  maxcho  do 
write ( ' C( 1 , col :1 , ' ) 1 , '  ‘:10); 
wnteln,- 

write  _ 

writeln( '  1  )~ 

for  row  :=  one  to  possiblestates  do  (*  loopl  *) 
begin 

write  (row: 4)  ,- 

for  col  :=  one  to  choices (. row. )  do  (*  loop2  *) 
write (benematrix( . row, col. ) : 14 :6) ; 

(*  end  of  loop2  *> 
writeln,- 
end  • 

(*  end  of  loopl  *) 

write  ( 1 _ 

writeln( 1  TT7 

end ; 


begin 


PART  II.  MAIN  PROGRAM  ***) 

'  ========  Input  Data  via  Terminal  =======  *) 

'  Step  I.  *) 

itnumof factor  (numfactor .possiblestates , scales) ; 

: tnumof choices (numf actor , possiblestates , choices, maxcho)  ,- 
:testprob  (numfactor , maxcho , scales , scalevals , estmatrix) ; 

'  ========  Get  Transition  Matrix  =========  *) 

*  Step  II.  *) 

;  ts ta tma t rix(numf actor, possibles tates , scales , scalevals , statmatrix) 
'ints  tatmatr ix (n'omf  actor  .possiblestates  ,  statmatrix)  ; 


prmthelpfile  (numfactor.possiblestates, statmatrix)  ; 

(*  Step  III.  *) 

Gettranmatrix(nun>.f  actor  .possibles  tates  ,  choices  .scales  ,  sea  leva  Is 
estmatnx,  statmatrix,  tranr.atnx)  : 

Pr in ttranmatrix( possibles tates , choices , tranmatrix) ; 

(*  ========  Get  Benefit  Matrix  =========  *) 

(*  Step  IV.  *) 

Goodr.essm.easure  (numf  actor ,  possibles  tates ,  statmatrix,  goodmatnx) 


(*  Step  V.  *) 

Getbenematrix  (possiblestates , choices , tranmatrix, 

goodmatrix,  benematrix); 

o rintbenematrix (possibles tates .maxcho , choices .benematrix) ; 
end;' 
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Ii.i*  Ah  L  r 


(*  ##########**##################################  M 


n  <$$#  * 

*  ###  G  C  M  PART  III.  ###  * 

*  ###  Generate  Long  Run  Policy  ###  * 

*  ###  This  part  processes  Howard's  algorithm  ###  * 

*  ###  main  modules  are  Dynamic  formulation,  ###  * 

*  ###  Resolve  variable,  and  Setnewaction  ###  * 


^  *-k’k'k'k-kn*-k**-kjek*n-kj:-k-k+:*-k-k-k4K-k-k'k'kjtJck'k'k£JcA,k,kJek’k,kn*  \ 

(''**’'*  GET  CHOICE  POLICY  *****) 

Procedure  Getchcice (possiblestates : integer ;  choices :choicetable ; 

tranmatrix : transitiontable ; 

benematrix rbenef ittable ;  var  policy :policytable) ; 

type 

markovtable  =  array  ( .one . .maxstate ,  one . .maxstateetc . )  of  real; 
determinval  =  array  ( .one . .maxstateetc . )  of  real; 


index 
i- j  . 

maxincome 


integer; 
integer ; 
real; 


markov 

resolution 

newpolicy 


markovtable 

determinval 

policytable 


reached,  matched, 
quitr.ow,  inforced  :  boolean,- 


f*  =========================================== 

(*  ==  PROCEDURE  Initialize  policy  Table  ==  *) 

(*  ===========================================  *) 

procedure  initialize (possiblestates iinteqer;  choices : choicetable ; 

benematrix -.benef  ittable,-  var  policy  rpolicytable); 


var 

row,  col  :  integer; 
max  :  real; 
begin 

for  row  ;=  one  to  possiblestates  do 
begin 

max  :=  -999; 

for  col  :=  one  to  choices (. row. )  do 
If  benematrix( .row, col. )  >  max  then 
begin 

max  -.=  benematrix(  .  row, col. ) ; 
policy( . row. )  :=  col; 
end; 

end; 

end; 

— ==— — — ==— =====—==========— — — ===== 

(*  ==  PROCEDURE  Dynamic  Formulation  ==  *> 

procedure  dynamic_formulation(vi : integer/  possiblestates : intecjer ; 

choices ichoicetable ;  tranmatrix : transitiontable 
benematrix  .-benef  ittable ;  policy  :  policy  table  ,- 
var  markov  .-markovtable) ; 


var 

row,  col  :  integer,- 

begin 

(*  fill  matrix  with  variable  coefficient  *) 
for  row  :=  one  to  possiblestates  do 
markov( . row, one . )  :=  l.O; 
for  row  -.=  one  to  possiblestates  do 

for  col  :=  one  to  possiblestates  do 
If  row  =  col  then 

markov( . row , col+1 . )  := 

1- ( tranmatrix( . ( row- 1 )*choices ( .row. )+policy( . row . ) , col . ) ) 

else 
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markov( .  row, col+1 . )  -.= 

-( tranmatrix( . (row-1 )*choices( . row. )+policy( . row. ) ,col. ) ) ; 
for  row  :=  one  to  possiblestates  do 

markov( . row,possiblestates+2 . )  :=  benematrix( . r ow, policy ( . row. ) . ) ■ 

*  remove  an  arbitary  vatiable  v(i)  *) 
or  row  :=  one  to  possiblestates  do 

for  col  :=  vi  +  one  to  possiblestates  +  one  do 
markov( .row, col. )  :=  markov (.row, col+1. ) ; 

end; 

==  _??2CEDHR?  _variables  ==  * 

procedure  Resolvevariable (vi : integer n : integer; 

var  markov imarkovtable ; 
var  resolution :determinval) ; 

var 

i,j,k  :  integer; 

multfac, 

temp  :  real; 

begin 

(x********  manipulate  markov  matrix  ***********) 
for  i  :=  1  to  n-1  do  begin 
if  markov( . i, i . )  <>  1  then 
begin 

multfac  :=  1/ (markov( . i, i. ) ) ; 
for  j  :=  i  to  n+1  do 

markov(.i, j . )  :=  markov( . i , j . )  *  multfac; 

end; 

for  j  :=  i+1  to  n  do 
begin 

multfac  :=  markov( . j , i . ) ; 
fcr  k  :=  i  to  n+1  do 

markov( . j ,k. )  :=  markov( . j ,k. )  -  (multfac  *  markov( . i , k. ) ) ; 

end; 

end; 

( -k-k-k-k-k-k-k-k-k  Solution  ************ ) 

resolution( .n. )  :=  markov( .n,n+l . )/markov( .n,n. ) ; 
for  i  :=  n-1  downto  1  do 
begin 

temp  :=  0; 

for  j  :=  i+l  to  n  do 
temp  ;=  temp  + 

(markovi  ,i, j  . )  *  resolution( . j . ) ) ; 
resolution( . i. )  :=  markov( . i , n+1 . )  -  temp; 
end; 

ror  j  :=  n  downto  vi  +  1  do 

resolution( . j+1 . )  :=  resoluticn( . j . ) ; 
resolution( . vi+1 . )  :=  0; 
end; 


;*  ==  PROCEDURE  Set  New  Action 


procedure  «etnewaction(possiblestates : integer ;  choices : choice table ; 

tranmatr ix : trans it ion table ; 
benema tr ix : benefit table ; 

resolution : de terminval ;  var  newpolicy tpolicytable 
policy :  policy table); 


type 


l._property  =  record 
tr  :  integer; 
al  :  real; 


var 


s? 


col,  cho,  loop, 
i ,  j , k,  seiectcode  •.  integer; 
temp, dynamic, max:  real; 

property  :  array  ( .one. .maxchoice . )  of  eval_property ; 

begin 

for  loop  :=  one  to  possiblestates  do 
begin 

max  -.=  -999; 

for  cho  :=  one  to  choices( .loop. )  do 
begin 

dynamic  -.=  0; 

for  col  :=  one  to  possiblestates  do  begin 

dynamic :=dynamic  + 

(tranmatrix( . (loop-l)*choices( . loop . )+cho , col . )  * 

resolution( . col+one . ) ) ; 

end; 


dynamic :=dynamic  +  benematrix( . loop , cho . )  ; 
property!  .cho. )  .ptr  :=  cho,- 
property! .cho. ) .val  s=  dynamic; 
end;  (*  end  of  choice  *) 

(*  sgrting  *) 

for  i  :=  choices (. loop . )  downto  two  do 
for  j  :=  one  to  i-1  do 

if  property! . i .) .val  >  property! .j .) .val  then  begin 
temp  :=  property ! .j .) .val; 


property !. j .) .val  :=  property! . i. ) .val; 
property! .1. ) .val  :*  temp; 
k  :=  property! .j .) .ptr ; 
property! . j .) .ptr  :=  property! . i. ) .  ' 

<**  «aafffr^Jfr1’5’ptr  end; 


ptr. 


if  (property! . 1 .) .val  >=  0)  and  (property (. 2 .) .val  >=  0)  then 
seiectcode  “  ' 
if  (property!. 1 
seiectcode 
if  (property!. 1 
seiectcode 


case  seiectcode  of 


=  1; 

. ) . val  >=  0)  and  (property! . 2 .) .val  <  0)  then 

. ) .val  <  0)  then 


.  1 . ) .val -property! .2.) .val)/ 
.l.).val)  <=  0.0001  then  (* 


identity  *) 


1  :  if  ( (property! . l .) .val-proper 

property! . 1 .) .val)  <=  _ 

newpolicy! .loop. )  :=  policy (. loop . ) 
else  newpolicy (. loop . )  :=  property! . 1 .) .ptr ; 

2  :  newpolicy! . loop . )  :=  property! • 1 •) .ptr ; (*  nonidentity  *) 

3  :  if  ( (property! .2.) .val-property( .1.) .val)/ 

property! .1 .) .val)  >  0.0001  then  (*  nonidentity  *) 
newpolicy! .  loop  . )  .-=  property (.  1 .)  .ptr 
else  newpolicy (. loop . )  :=  policy (. loop . 

end; 

end;  (*  end  of  loop  *) 


end; 


(***  PART  III  MAIN  PROGRAM  ***) 
begin 

vi  :=  possiblestates; 
repeat 

!*  step  I.  *) 

Initialize (possiblestates , choices , benematrix .policy ) ; 
maxincome  -999.0; 
inforced  :=  false; 
repeat 

(*  Step  II.  *) 

Dynamic_formulation(vi, possiblestates .choices , 

tranmatrix,  benematrix,  policy,  markov) ; 

(*  Step  III.  *) 

Re solvevariable (vi , possible  states .markov, resolution) ; 
for  i  :=  1  to  possiblestates  +  1  do 
(*  Step  IV.  *) 

setnewact ion (possible states , choices , tranmatrix, benematrix, 


S'S 


resolution, newpolicy, policy) ; 
quitnow  :=  false; 

if  maxincome  <=  resolution( .one. )  then 
begin 

index  :=  0; 
quitnow  :=  true; 
repeat 

index  :=  index  +  1; 
reached  :=  (index  >=  possiblestates) ; 
matched  :=  (policy (. index . )=newpolicy( . index. )) ; 
quitnow  quitnow  and  matched; 
policy( . index. )  :=  newpolicy( . index. ) ; 
until  reached; 

if  quitnow  and  ( resolution( . one . )  <  0)  then  inforced  :=  true 
else  maxincome  :=  resolution( . one . ) ; 

end 

else  inforced  :=  true:  (*endif  maxincome*) 
until  (quitnow  or  inforced); 

Vi  :=  Vl-1: 

if  (vi  =  0)  and  (not  quitnow)  then  writeuser ( IMPOSSIBLE ) ; 
until  ((quitnow  and  (not  inforced))  or  (vi=0)); 
vi  :=  vi  +  1: 

gain  :=  resolution( . one . ) ;  (*printed  on  policytable*) 

end; 


[*  ##########################################  * 
*  ###  ###  * 

*  ###  G  C  M  PART  IV.  ###  * 

(  *  ###  *' 

*  ##########################################  * 


tK*K*A**^*A^x*3*r*^x*A*^*^* 'k'kic'k * **************  \ 

**  INTERACTION  ***) 

:edure  interaction(possiblestates : integer ;  policy :policytable ) 

a 

elementtable  =  array (. one . .maxfactor . )  of  real; 
oneline  =  packed  array( . one .. seventy . )  of  char; 


current  :  integer,- 

elements  :  elementtable; 
line  :  oneline; 

vesno  :  char; 

doall,  nomore, 
needhelp  :  boolean; 


*  ==  Do  Partial  Decision  policy  == 

procedure  dopartial(possiblestates : integer ;  policy :policytable) ,- 
begin 

wnteln('Do  you  want  to  see  Helpfile  for  current  problem  ?  y/n1); 
readln(yesno)  ; 

needhelp  :=  (yesno=‘Y')  or  (yesno= 1 y 1 ) ; 
if  needhelp  then  begin 

reset  (helpfile,  'helpfile  data'); 
while  not  eof (helpfile )  do  begin 
readln(helpfile ,  line); 
writeln(line) ;  end; 
end; 

repeat 

writeln( ' What  is  your  current  state  ?  ==->  Type  n'); 

readln(current) ; 

until  (current  >  0)  and  (current  <=  possiblestates); 
writeln; 

write  ('Current  State  :  currents,  '  ); 

wnteln(  1  Best  Choice  :  policy (. current .): 2 ) ; 

writeln ,- 
end; 


PRINT  POLICY  TABLE 


procedure  printpolicy (possiblestates :integer;  policy :policytable ) ; 
var 

loop,  cnt  :  integer; 

begin 
page ; 

writeln ( 1  :27); 

writeln ( ' Decision  Choices '  :27 )  ; 

writeln( ' _ 1  :27) ; 

writeln; 

writeln; 

writeln( 1  State  Choice  Policy'); 

writeln  'Z(i)  C(k) 

writeln(  1 _ '  )  ; 

writeln ; 
cr.t  :=  0; 

for  loop  :=  one  to  possiblestates  do  (*  loop2  *) 
begin 

writeln( loop :4 ,  '  1 : 30 ,  policy! . loop .) :3) ; 


(*  loop2  *) 
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cnt  :=  cnt  +  1; 

if  (cnt  mod  3)  =  0  then  readln(wait) ; 
end; 

writeln( ' _ 

writeln ; 

wnteln('set  arbitary  v(‘,  vi:2,  ' )  to  O'); 
writeln; 

writeln( 'maxincome  per  period  :  gain); 

writeln; 


begin 
repeat 
page  ; 

wnteln('Do  you  want  all  decision  policy  ?  y/n1) 
readln(yesno) ; 

doall  :=  (yesno='Y')  or  (yesno='y'); 

if  doall  then  printpolicy (possiblestates , policy) 
else  dopa rtial(poss lb le s ta te s , policy) ; 

writeln('Do  you  have  another  ploblem  ?'); 
readln(yesno) ; 

nonore  :=  (yesno='N')  or  (yesno='n'); 
until  nomore; 
end; 


(*  ##########################################  * 
*  ###  ###  * 
(*  ###  G  C  M  PART  V.  ###  * 

(*  ###  Exit  Garbage  Can  Prog.  ###  * 

(*  ##########################################  * 


/**********************************************\ 

/****  GET  boolean  value  ***) 

^ ********************************************** \ 

Procedure  Getboolean(var  Exit :boolean) ; 
begin 

Exit  :=  true; 
page  ; 
end; 


********************************************** 

***  End  of  Garbage  Can  Model  Program  *** 
********************************************** 


/********************************************** \ 

(*****  HAIM  PROGRAM  *****) 

/********************************************** \ 

begin 

Quitnow  :=  false,- 
While  not  quitnow  do  begin 
if  getcommand(command)  then 
Case  command  of 
EXECGCM  •.  begin 

Getmatrix(possible states , choices , 

tranmatrix.benematrix) ; 
Getchoice( possible states , choices , 

tranmatrix.benematrix, policy) 
In ter act ion (possible states .policy) ; 
end; 

EXECEXIT  :  Getboolean(Quitnow) ; 
end 

else  Writeuser (BADLINE)  ; 
end; 
end. 


APPENDIX  B 
USER  MANUAL 


PGCM  Program,  1987 

I.  PROGRAM  NAME  :  pgcmprog  (written  in  Waterloo  pascal  language) 

II.  PURPOSE  :  Get  a  set  of  choices  available  in  a  specific  organization 

problem 

I I I.  TO  USE: 


1.  Before  Execution 

1)  Formulate  problem  and  set  alternative  actions 

2)  Turn  on  your  terminal 

3)  LOGIN  userid 

4)  ENTER  PASSWORD ( IT  WILL  NOT  APPEAR  WHEN  TYPED): 

5)  Memory  extention  (if  necessary) 

:  DEF  STOR  1500k 
:  I  CMS 

6)  Execute  garbage  can  program 

:  pw  gcmprog  pascal 

2.  During  Execution 

1)  Select  menu  option 


1  .  ExecGCM 

2  .  ExitGCM 


2)  Enter  number  of  scale  points  for  each  factor 
i.e>  factor  1:3 
factor  2  :  2 
factor  3  :  2 

====«>  possible  states  :  3  x  2  x  2  =  12 
4)  Enter  number  of  choices  for  each  state 
i.e>  state  1  ?  2 
state  2  ?  2 
state  3  ?  3 
state  4  ?  3 
state  5  ?  3 
state  6  ?  3 
state  7  ?  2 
state  8  ?  2 
state  9  ?  3 
state  10?  3 
state  11?  3 
state  12?  3 

======>  maxchoices  :  3 

4)  Enter  estimation  probabilities 

if  user  has  the  following  input  data. 


cho  1 

factorl (P) 

P 

0.0  0.5  1.0 

cho  | 

factor2(S) 

S 

0.0  1.0 

cho  j 

factor3(E 

E 

0.0  1.0 

~r 

<j7z 

074 

1373 

1 

1  0.1 

07b 

1 

1  C .  3 

0.6 

1 

1 

0.3 

0.5 

0.5 

0.1 

0.5 

0.2 

1 

I  0.9 

0.4 

1 

|  0.7 

0.4 

cho  | 

0.0 

0.5 

1 .0 

cho  | 

0.0 

1.0 

cho  j 

0.0 

1.0 

i 

j  6.1 

6.5 

0.2 

5 

|  0.5 

0.1 

2 

1  0.2 

0.9 

-> 

L. 

2 

0.5 

1  0.4 

0.3 

0.4 

0.2 

0.6 

2 

I  0.5 

0.9 

2 

1  0.3 

0.1 

cho  j 

0.0 

0.5 

1.0 

cho  I 
1 

0.0 

1.0 

cho 

0.0 

1.0 

3 

;  o.i 

6.7 

uam 

i~57r 

0.3 

3 

|~ 675" 

0 . 5 
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0.1  0.2  0.3 
0.8  0.1  0.5 


3  |  0.2  0.7 


3  |  0.6  0.5 


I 


r.\^ 


s"' 

7:-\' 
iVf* 


w-. 


* > 


Interact  with  the  folowing  manner 


(factorl) 

Initial  State  f(l)  =  0.C0 

Terminal  State 
probl  prob2  prob3  ? 


Choice  C( 1 ) 


i 

"O  571  57s 

I 

*  rectangle  :  input  data  I 

Initial  State  f(l)  =  0.50 

Terminal  State 
probl  prob2  prob3  ? 


0.4 


075 


0.1 


Initial  State  f(l)  =  0.10 

Terminal  State 
probl  prob2  prob3  ? 


Choice  C(l) 


Choice  C(l) 


itt 


■yrr 


0.2 


(factor2) 

(factor3) 

*  choice  2  and  choice  3  operations  are  the  same 
3.  After  Execution 

1)  Do  you  want  all  decision  policy  ?  y/n 
yes 


no 


display  all  choice  policies 

Do  you  want  to  see  Helpfile  for  current  problem  ?  y/n 
yes 

Bisplay  organizational  states  for  memory  aids 
at  is  your  current  state  ?  ===>  Type  n 


What 


no 


What  is  your  current  state  ?  ===>  Type  n 

2)  Do  you  have  another  ploblem  ? 
yes 


no 


go  to  procedure  3.1 


go  to  procedure  2.1 


4.  Get  results 
1)  PRINT  OUT 


:  PRINT  gcmprog  listing 
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APPENDIX  C 

OFFENSIV  E  OPERATION  EXAMPLE 


/■A’kick'k-k-kyfk'k-k-k'k'k-k-k-k'k'k-k-k’k-k'k'k'k-k'k'k’k'k-k-k'k') 

)  •k’k  **  \ 

(**  Step  I  :  User  Interaction  **) 

/  **  A*  \ 

}*-k'k-k-k-kx-k*-k-k7ck-k'kJck'A-k*Kk-k-k'k-k*Jck-k-k-k1<-k{ 

I.  Formulate  problem  and  prepare  estimation  probabilities 


Importance  of  problems  to  be  solved 
Degree  of  ef fectiveness  in  problem-solving 
Potential  energy  of  participants 


pl=0  No  significant  problem  regarding  attack  forces, 
mission  load,  weather,  relation  with  consequent 
military  operation 


p2=.5  Moderate  shortage  of  attacking  forces,  not  good 
weapon  system  good  weather,  a  certain  time  delay 
to  the  consequent  operation 


p3=l  Acute  shortage  of  attacking  forces,  big  mission 
load,  bad  weather,  a  tremendous  time  delay  to  the 
consequent  operation 


S1=0  Most  of  personnel  have  no  experience  in  the  battle 
field,  poor  coordination  with  adjacent  unit, 
poor  performance  weapon  systems 


S2= . 5  Some  personnel  have  an  experience  in  the  battle 
field,  appropriate  coordination  and  reasonable 
attack-defense  forces  ratio,  good  performance 
weapon  systems,  good  logistic  support  systems 


53=1  Some  personnel  have  an  experience  in  the  battle 
field,  excellent  coordination,  best  attack-defense 
forces  ratio,  excellent  performance  weapon  systems 
,  sufficient  logistic  support  systems 


E1=0  Not  quite  proud  of  their  operations .passive  action 


E2=l  High  morale,  high  responsibility 


P  S  E 


1 

0.98 

0.19 

0.01 

0.97 

0.01 

0.01 

0.95 

0.01 

1 

0.01 

0.80 

0.02 

0.02 

0.70 

0.01 

0.05 

0.99 

1 

0.01 

0.01 

0.97 

0.01 

0.29 

0.98 

2 

0.98 

0.70 

0.10 

0.20 

0.01 

0.01 

0.20 

0.01 

2 

0.01 

0.29 

0.50 

0.70 

0.19 

0.01 

0.80 

0.99 

2 

0.01 

0.01 

0.40 

0.10 

0.80 

0.98 

3 

0.98 

0.80 

0.39 

0.90 

0.01 

0.01 

0.70 

0.05 

3 

0.01 

0.19 

0.60 

0.09 

0.39 

0.01 

0.30 

0.95 

61 


3 

0.01 

0.01 

0.01 

0.01 

0.60 

0.98 

4 

0.30 

0.10 

0.20 

0.30 

0.20 

0.30 

4 

0.60 

0.80 

0.60 

0.60 

0.60 

0.40 

4 

0.10 

0.10 

0.20 

0.10 

0.20 

0.30 

0.20 

0.80 


II.  Execution 


Select  Menu  Option 

1.  ExecGCM  (Execute  GCM  Program 

2.  ExecExit(Execution  stop 


Enter  #  of  scale  points  for  each  factor  : 


factor 

1  : 

3 

factor 

2  : 

3 

factor 

3  : 

2 

goahead  s  Press  any  key,  correction  :  "%" 


Get  Number  of  Choices  for  each  State  Z(i)  i  =  1  ..  18 


State  Z(i) 

— ir^r 

choices 

1  ? 

4 

2  ? 

4 

3  ? 

4 

4  ? 

4 

5  ? 

4 

6  ? 

4 

7  ? 

4 

3  ? 

4 

9  ? 

4 

10  ? 

4 

11  ? 

4 

12  ? 

4 

13  ? 

4 

14  ? 

4 

15  ? 

4 

16  ? 

4 

17  ? 

4 

13  ? 

4 

•  Ii3.ll 

•  O 

goahead  :  Press 

i  any  key,  correction 

Get  Estimation 

Probabilities 

( factorl ) 
Initial  State 
Terminal  State 

f(D  = 

0.00 

Choice 

C(1) 

probl  prob2 

prob3  ? 

0.98 

0.19  0. 

01 

Initial  State 
Terminal  State 

f(l)  = 

0.50 

Choice 

C(1) 

probl  prob2 

prob3  ? 

0.01 

0.80  0. 

02 

Initial  State 
Terminal  State 

f(l)  = 

1.00 

Choice 

C(1) 

probl  prob2 

prob3  ? 

0.01 

0.01  0. 

97 

0.30 

0.70 
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★*********************************\ 
★  *  kA\ 

**  Step  II  :  Generate  Matrices  **) 

**  X*  \ 

*********:fr**x***x**********c***x**x\ 


Transition  Matrix 


Initial  State  :  Z  1 


state  CC17  C(T)  C(3)  Cf4) 


1 

X 

mii  i  mi  ■ 

miihi  1 1 1 

■PH  HTT  I'I 

2 

0.047530 

0.156300 

0.264600 

0.072000 

3 

0.018620 

0.137200 

0.061740 

0.036000 

4 

0.000930 

0 . 548800 

0.026460 

0.144000 

5 

0.009310 

0.019600 

0.006360 

0.006000 

6 

0.000490 

0.073400 

0.002940 

0.024000 

7 

0.009215 

0.000400 

0.006300 

0.036000 

8 

0.000485 

0.C01600 

0.002700 

0.144000 

Q 

3 

0 .000190 

0.001400 

0.000630 

0.072000 

10 

0.000010 

0.005600 

0.000270 

0.288000 

11 

0.000095 

0.000200 

0.000070 

0.012000 

12 

0.000005 

0.000800 

0.000030 

0.048000 

13 

0.009215 

0.000400 

0.006300 

0.006000 

14 

0.000485 

0.001600 

0.002700 

0.024000 

15 

0.000190 

0.001400 

0.000630 

0.012000 

16 

0.000010 

0.005600 

0.000270 

0.048000 

17 

0 .000095 

0.000200 

0.000070 

0.002000 

13 

0.000005 

0.000800 

0.000030 

0.008000 

Initial  State  :  Z  2 


itate 

cm - 

cm 

C  ( 3 ) 

C(4) 

1 

(j.  609506 

M  il  l  Mil  WM 

IMMSEETOMBB 

2 

0.941094 

0.194040 

0.837900 

0.063000 

3 

0.000196 

0.006860 

0.004410 

0.054000 

4 

0.019404 

0.679140 

0.083790 

0.126000 

5 

0.000098 

0.000980 

0.000490 

0.009000 

6 

0.009702 

0.097020 

0.009310 

0.021000 

7 

0.000097 

0.000020 

0.000450 

0.054000 

8 

0.C096C3 

0.001980 

0.008550 

0.126000 

9 

0.000002 

0.000070 

0.000045 

o.ioaoco 

10 

0.000198 

0 .006930 

0.000855 

0.252000 

i  I 

C .000001 

0.000010 

0.000005 

0.018000 

12 

0.000099 

0.000990 

0.000095 

0.042000 

13 

0.000097 

0.00002C 

0.000450 

0.009000 

14 

0.009603 

0.0C1980 

0.008550 

0.021000 

15 

0.000002 

0 .000070 

0.000045 

0.018000 

1  o 

0  .  C  0  0 1 9  8 

0.006930 

0.000355 

0.042000 

17 

0.000001 

0.000010 

0.000005 

0.003000 

13 

0.000099 

0.000990 

0.000095 

0.007000 

W  1  IP 


Initial  State  :  Z  5 


state 

- cTT5 - 

cTTS 

cTT) 

UJ) 

1 

0. <309310 

3.331955 

3.036833 

0.018030 

2 

0.000490 

0.007840 

0.002940 

0.072000 

3 

0.009310 

0.001960 

0.006360 

0.024000 

4 

0.000490 

0.007340 

0.002940 

0.096000 

5 

0.912330 

0.1920S0 

0.672280 

0.018000 

6 

0.046020 

0.763320 

0.288120 

0.072000 

7 

0.000095 

0.000020 

0.000070 

0.036000 

8 

0.000005 

0.000080 

0.000030 

0.144000 

9 

0 . 000C95 

0.000020 

0.000070 

0.048000 

10 

0.000005 

0.000080 

0.000030 

0.192000 

11 

0.009310 

0.001960 

0.006860 

0.0360C0 

12 

0.00C490 

0.007840 

0.002940 

0.144000 

13 

0.000095 

0.000020 

0.000070 

0.006000 

14 

0.000005 

0.000080 

0.000030 

0.024000 

15 

0.000095 

0.000020 

0.000070 

0.008000 

16 

0.000005 

0.000080 

0.000030 

0.032000 

17 

0.009310 

0.001960 

0.006860 

0.006000 

13 

0.000490 

0.007340 

0.002940 

0.024000 

Initial 

State  :  Z  6 

state 

C  ( 1 ) 

C(2) 

— cm 

C(4) 

1 

0.000098 

0.000053 

3.000490 

0. 027030 

2 

0.009702 

0.009702 

0.009310 

0.063000 

3 

0.000098 

0.000098 

0.000490 

0.036000 

4 

0.009702 

0.009702 

0.009310 

0.084000 

5 

0.009604 

0.009604 

0.048020 

0.027000 

6 

0.950796 

0.950796 

0.912380 

0.063000 

7 

0.000001 

0.000001 

0.000005 

0.054000 

8 

0.000C99 

0.000099 

0.000095 

0.126000 

9 

0.000001 

0.000001 

0.000005 

0.072000 

10 

0.000099 

0.000099 

0.000095 

0.168000 

11 

0.000098 

0.000093 

0.000490 

0.054000 

12 

0.009702 

0.009702 

0.009310 

0.126000 

13 

0.000001 

0.000001 

0.000005 

0.009000 

14 

0.000099 

0.C00099 

0.000095 

0.021000 

15 

0.000001 

0.000001 

0.000005 

0.012000 

16 

0.000099 

0.000099 

0.000095 

0.028000 

17 

0.000098 

0.000098 

0.000490 

0.009000 

13 

0.009702 

0.009702 

0.009310 

0.021000 

•4 
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v»  'V* 


im»»iinni«  ■■■■■■■  i  »«»■■■»'■  »■  i"  »—  »"«■«"  r-  *.  11 


Initial  State  :  Z  7 


g 

I 


$ 

»*> 


i 

■S 

f; 


state 

C(l) 

cm 

C(3) 

cir 

1 

(5 . 175085 

0 . 02^006 

6.504000  * 

0.066600 

2 

0.009215 

0.112000 

0 .216000 

0.024000 

3 

0.003610 

0.093000 

0.050400 

0.012000 

4 

0.000190 

0.392000 

0.021600 

0.048000 

5 

0.001805 

0.014000 

0.005600 

0.002000 

6 

0.000095 

0.056000 

0.002400 

0 . C08000 

7 

0.737200 

0.011600 

0.119700 

0.043000 

3 

0 . 033300 

0.046400 

0 . C  51300 

0.192000 

9 

0.015200 

0.040600 

0.011970 

0.096000 

10 

0 . 000800 

0.162400 

0.005130 

0.384000 

11 

0  .  C  0  7  6  0  0 

0.00530 0 

0.001330 

0.016000 

12 

0.000400 

0.023200 

0.000570 

0.064000 

13 

0.009215 

0.000400 

0.006300 

0.006000 

14 

0.000435 

0.001600 

0.002700 

0.024000 

1  5 

0.000190 

0.001400 

0.000630 

0.012000 

16 

0 .000010 

0.005600 

0.000270 

0.048000 

17 

0.000095 

0.000200 

0.000070 

0.002000 

13 

0.000005 

0.000800 

0.000030 

0.008000 

Initial 

State  :  Z  8 

state 

cm 

~c{2) 

'  cJTj 

cTTT~ 

1 

■A. 

0.001843 

0“  001400 

0Y066000 

0.009000 

2 

C. 182457 

0.138600 

0.684000 

0.021000 

3 

0.000028 

0.004900 

0.003600 

0.018000 

4 

0.003762 

0.43510 0 

0.068400 

0.042000 

5 

0.000019 

0.000700 

0.000400 

0.003000 

6 

0.001831 

0.069300 

0.007600 

0.007000 

7 

0 .007760 

0.000580 

0.008550 

0.072000 

3 

0.758240 

0.057420 

0.162450 

0.168000 

9 

0.0C0160 

0.002030 

0.000855 

0.144000 

10 

0.015840 

0.2CC97C 

0.016245 

0.3360CC 

7  1 

0.000080 

C.C0029 0 

0.000095 

0.024000 

12 

0.007920 

0.028710 

0.001805 

0.056000 

13 

0.CC0C97 

0.000020 

0.000450 

0.009000 

14 

0 . 0  C  9  6  0  3 

0.001950 

0.008550 

0.021000 

0 . 000002 

0 .000070 

0.000045 

0.018000 

16 

0.000198 

C. 006930 

0.000355 

0.042000 

17 

0.000001 

0 .000010 

0.000005 

0.003000 

13 

0.000099 

0.000990 

0.000095 

0.007000 

V\’ 


fcv 


h*„  *' 

* 

r\ 

Initial  State 

:  Z  10 

\J 


0.000019 

0.C00076 

0.000400 

0.006000 

0.001331 

0.006930 

0.007600 

0.014000 

0.001330 

0.001330 

0.015600 

0.018000 

0.131670 

0.13167C 

0.296400 

0.042000 

0 . 0  C  0  5  5 1 

0.005600 

0.024000 

0.006000 

C. 054549 

0.554400 

0.456000 

0.014000 

0 .000080 

0 .000029 

0.000095 

0.048000 

0.007920 

0.002871 

0.001805 

0.112000 

0.005600 

0.000551 

0.003705 

0.144000 

0.554400 

0.054549 

0.070395 

0.336000 

0.002320 

0.002320 

0.005700 

0.048000 

0.229630 

0.229630 

0.108300 

0.112000 

0.000001 

0.000001 

0.000C05 

0.006000 

0.000099 

0.000099 

0 .000095 

0.014000 

0.000070 

0.000019 

0.000195 

0.018000 

0.006930 

0.001381 

0.003705 

0.042000 

0.000029 

0.000C80 

0.000300 

0.006000 

0.002871 

0.007920 

0.005700 

0.014000 

O  tX)  Oo  --J  O'  tn«{^  U>  K)  HJ|  Cl  fT.  I  OJ  -J  O' U>  O  v£)  CQ  "--I  O' cn  0)ts)H 


ITTTTTf 

1 11 1 1 II 1  M 

MiHil'lliriiM 

0.000095 

0.005600 

0.002400 

0.024000 

0.001805 

0.001400 

0.005600 

0.008000 

0.000095 

0.005600 

0.002400 

0.032000 

0.176390 

0.137200 

0.548300 

0.006000 

0.009310 

0.548300 

0.235200 

0.024000 

0.007600 

0.000530 

0.001330 

0.043000 

0.0C0400 

0.002320 

0.000570 

0.192000 

0.007600 

0.000580 

0.001330 

0.064000 

0.00C400 

0.002320 

0.000570 

0.256000 

0.744300 

0.056840 

0.130340 

0.048000 

0.039200 

0.227360 

0.055360 

0.192000 

0.000095 

0.000020 

0.000070 

0.0C6000 

0.000005 

0 . 000060 

0.000030 

0.024000 

0.000095 

0.000020 

0.000070 

0.003000 

0.000005 

0.000030 

0.000030 

0.032000 

C. 009310 

0.001960 

0.006860 

0.006000 

0.000490 

0.007840 

0.002940 

0.024000 

.al  State  :  2  12 


cm  cm  cm  ciry 


C .000019 

WM  HIM  i\  mi 

0.000400 

M'Hil'IIM'I'l 

0.0C1SS1 

0.006930 

0.007600 

0.021000 

0.000019 

0.000070 

0.000400 

0.012000 

0.001381 

0.0C6930 

0.007600 

0.028000 

0 .001362 

0.006860 

0.039200 

0.009000 

0.134333 

0.679140 

0.744800 

0.021000 

0 .000080 

0.000029 

0.000095 

0.072000 

0.007920 

0.002871 

0.001805 

0.168000 

0 .000080 

0.0G0029 

0.000095 

0.096000 

0.007920 

0.002371 

0.001805 

0.224000 

0.007340 

0.002842 

0.009310 

0 . 07  2000 

0.776160 

0.281358 

0.176890 

0.1680C0 

0.000001 

0.000001 

0.000005 

0.009000 

0.000099 

0.000099 

0.000095 

0.021000 

G ,00000 1 

0.000001 

0.000005 

0.012000 

0.000099 

0.000099 

0.000095 

0.028000 

G. 000098 

0.00009S 

0.000490 

0.009000 

0.009702 

0.009702 

0.009310 

0.021000 

Initial  State  :  Z  15 


state 

cm 

c{2) 

cm 

1 

6 . 060065  ~ 

'  5.66o266 

0 .002136 

'  6.003000 

2 

0.000005 

0.000800 

0.001170 

0.032000 

3 

0.006650 

0.003800 

0.106470 

0.024000 

4 

0.000350 

0.015200 

0.045630 

0.096000 

5 

0.002755 

0.016000 

0.163300 

0.008000 

6 

0.000145 

0.064000 

0.070200 

0.032000 

7 

0.000190 

0.001000 

0.004200 

0 . 0240C0 

3 

0 .000010 

0.004000 

0.001800 

0.096000 

9 

0.013300 

0.019000 

0.163800 

0.072000 

10 

0.000700 

0 .076000 

0.070200 

0.238000 

11 

0.005510 

0.080000 

0.252000 

0.024000 

12 

0.000290 

0.320000 

0.108000 

0.096000 

13 

0.009215 

0.000800 

0.000070 

0.003000 

14 

0.000485 

0.003200 

0.000030 

0.032000 

15 

0.645050 

0.015200 

0.002730 

0.024000 

16 

0.033950 

0.060800 

0.001170 

0.096000 

17 

0.267235 

0 .064000 

0.C042C0 

C. 003000 

18 

0.014065 

0.256000 

0.001800 

0.032000 

Initial 

State  :  Z  16 

state 

cm 

cm 

C  ( 3 ) 

C(4) 

1 

■  0.000001 

0.000010 

6. 006163 

07612000' 

2 

0.C00099 

0.C00990 

0.003705 

0.023000 

3 

0.000070 

0.000190 

0.007605 

0.036000 

4 

0.006930 

0.018810 

0.144495 

0.084000 

5 

0.000029 

0.000800 

0.011700 

0.012000 

6 

0.0C2871 

0.079200 

0.222300 

0.028000 

7 

0.00C002 

0.000050 

0.000300 

0.036000 

8 

0.000193 

0.004950 

0.005700 

0.084000 

9 

0.000140 

0.000950 

0.011700 

0.108000 

10 

0.013860 

0.094050 

0.222300 

0.252000 

J.  i 

0 . 0000  58 

0.004000 

0.018000 

0 . 036000 

12 

0.005742 

0.396000 

0.342000 

0.G84000 

x  J 

0.000097 

0.000040 

0.000005 

0.012000 

1 4 

0.009603 

0.003950 

0.000095 

0.028000 

15 

0.006790 

0.000760 

0.000195 

0.036000 

1  0 

C .572210 

0.075240 

0.003705 

0.084000 

17 

0.002813 

0.003200 

0.000300 

0.012000 

13 

0.278437 

0.316800 

0.005700 

0.028000 

Initial  State 


state  C 


.al  State  :  Z  18 


1 II 1 1 1 1 11 

■BiBiTAlifliHa 

C. 018000 

0.000099 

0.000990 

0.C03705 

0.042000 

0. C0C001 

0.000010 

0.000195 

0.024000 

0.000099 

0.000990 

0.003705 

0.056000 

0.000093 

0.000930 

0.019110 

0.018000 

0.009702 

0.097020 

0.363090 

0.042000 

0.000002 

0 ,000050 

0.000300 

0.054000 

0.000198 

0.004950 

0.005700 

0.126000 

0.000002 

0.000050 

0.000300 

0.072000 

0.000198 

0.004950 

0.005700 

0.168000 

0.000196 

0 .004900 

0.0294C0 

0.054000 

0.C19404 

0 .485100 

0.558600 

0.126000 

C.CC0097 

0.000040 

0.000005 

0.018000 

0.009603 

0.003960 

0.000095 

0.042000 

0.000097 

0.000040 

0.000005 

0.024000 

0.009603 

0.003960 

0.000095 

0 .056000 

0.009506 

0.003920 

0.000490 

0.018000 

0.941094 

0.388080 

0.009310 

0.042000 

k>l 


0.00 
0.50 
0.50 
1.00 
1.00 
0.00 
0.00 
0.50 
0.50 
1 .00 
1.00 
0.00 
0.00 
0.50 
0.50 
1.00 
1.00 


Benefit 


1.00 

0.50 

1.50 

1.00 

2. CO  ideal 
-0.50 
0.50 
0.00 
1.00 
0.50 
1.50 

-1.00  anti-ideal 

0.00 

-0.50 

0.50 

0.00 

1.00 


Matrix 


State 

2(1)  C(l) 

0(2) 

C(3) 

0(4) 

i 

0.055000 

1.235000 

0.340000 

0.800000 

2 

-0.005000 

0.425000 

-0.010000 

-0.300000 

3 

0.175000 

1.130000 

0.580000 

0.400000 

4 

0.115000 

0.370000 

0.230000 

-0.700000 

5 

0.020000 

0.770000 

0.270000 

-0.100000 

6 

-0.040000 

-0.040000 

-0.080000 

-1.200000 

7 

G. 160000 

1.595000 

0.750000 

1.200000 

e 

0.10000C 

0.735000 

0.400000 

0.100000 

9 

0.280000 

1.540000 

0.990000 

0.800000 

10 

0.220000 

0.7300C0 

0.640000 

-0.300000 

11 

0.125000 

1.130000 

0.630000 

0 . 300000 

12 

0.065000 

0.320000 

0.330000 

-0.800000 

13 

0.090000 

1.600000 

1  .045000 

1.700000 

14 

0 .030000 

0.790000 

0.695000 

0.600000 

15 

0 .210000 

1.545000 

1 .265000 

1.300000 

1 6 

0.150000 

0.735000 

0.935000 

0.200000 

17 

0.055000 

1.135000 

0.975000 

0.800000 

1 3 

-0.005000 

0.325000 

0.625000 

-0.300CC0 

•< 


Decision Choices 


State  Choice  Policy 

Z(i)  C(k' 


set  arbitary  v(18)  to  0 

maxincome  per  period  :  2.220446049E-15 


APPENDIX  D 

UNIVERSITY  SCHEDULE  EXAMPLE 


^AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA 
A  A  Ax 

**  Step  I  :  User  Interaction  ** 

A  A  A  A 

AxAAxAAAAAAAAAAAAAAAAAAAAAAAAAAAAA 

.  Formulate  problem  and  prepare  estimation  probabilities 


Problem  description 

Importance  of  problems  to  be  solved 
Degree  of  effectiveness  in  problem-solving 
Potential  energy  of  participants 

pl=0  No  important  problem  regarding  teaching  load,  class 
size,  and  thesis  advising 

p2=.5  Moderate  faculty  shortage,  large  adjunct  faculty,  big 
class  size,  insufficient  thesis  advisors,  shortage  of 
required  infrastructural  facilities 

p3=i  Acute  shortage  of  faculty,  immense  class  size,  heavy 
thesis  load,  and  conflicts  in  class  scheduling 

31=0  Very  poor  quality  teaching  and  research  facultv,  poor 
administration,  inability  to  attract  new  'faculty, 
uncontrolled  student  admission 

S2= . 5  Moderately  effective  faculty,  reasonable  student  - 
faculty  ratio,  nominally  effective  administration 

53=1  Excellent  quality  teaching  and  research  faculty,  best 
student  -  faculty  ratio,  effective  administration  and 
leadership , ample  supporting  infrastructural  facilities 

E1=0  Faculty  uninterested  in  teaching,  insufficient  time 
devoted  to  problem  solving,  low  motivation 

E2=l  High  motivation,  good  productivity  and  commitment, 
dedicated  teaching  faculty,  administrators 


Alternative  choices 

3(1)  Hire  new  faculty 

C'2)  Administer  existing  faculty  better 

C'3;  Regulate  student  admission 

C;4)  Tailor  class  size  to  faculty  availability 

C(5)  Add  infrastructural  facilities 


Get  Estimation  Probabilities 


( factorl ) 
Initial  State 

f(l)  = 

0.00 

Choice 

C(i) 

Terminal  State 
prcbl  prob2 

prob3  ? 

C .  94 

0.05  0. 

01 

Initial  State 

f(l)  = 

0.50 

Choice 

C(1) 

Terminal  State 
probl  prob2 

prcb3  ? 

0.74 

0.25  0. 

01 

Initial  State 

f(l)  = 

1.00 

Choice 

C(1) 

Terminal  State 
probl  prob2 

prob3  ? 

0.05 

0.30  0. 

65 

(*  Display  Input  Data  *) 

— 3773 - 033 - 1733" 

I  3757  3774  73 

i  0.05  0.25  0.30 

i  0.01  0.01  0.65 

goahead  :  Press  any  key,  correction  :  "%" 


'  ■k-k'k'k-k'k'k'k-k'k'k'k'k'k-k-k'k-k-k'k'k'k-kX'k'k'k'k'k-klfk-k-k  > 
>  *  *  *  ★  ^ 

;**  Step  II  :  Generate  Matrices  **{ 
>**  r  * 
^*****X******J!*XK*«****X***IT**KK***' 


Transition  Matrix 


Initial  State  :  Z  1 


state 

WKBttMBM 

HHBHH 

C{3) 

- cT4l - 

■arniimi 

TU  TU  P  I  —— 

*> 

C. 031020 

0.019400 

0.034560 

0.074195 

3 

0.503540 

0.547030 

0.480480 

0.219330 

4 

0.243160 

0.364720 

0.047520 

0.027170 

5 

0.062930 

0.005320 

0.043680 

0.025365 

6 

C  .  0  3 1 C  2  0 

0.003330 

0.004320 

0.003135 

2.003350 

0.000600 

0.010920 

0.025276 

3 

0.001650 

0.000400 

0.001080 

0.003124 

G 

C .026300 

0.011260 

0.015015 

0.009256 

*  n 

0 .013200 

0.007520 

0.001485 

0.001144 

I: 

0.003350 

C.C00120 

0.001365 

0.001065 

12 

0 . 0016  50 

0.000080 

0.000135 

0.000132 

13 

0.000670 

0.000300 

0.003640 

0.006319 

'  4 

*  “t 

0.0CC330 

0.000200 

0.000360 

0 . C00731 

15 

G. 005360 

C. 005640 

0.005005 

0.C02314 

1 5 

0.002640 

G. 003760 

0.000495 

0.000236 

0 . 00  067  0 

0.000060 

0.000455 

0.000267 

1 3 

C.0C0330 

0.000040 

0 .000045 

0.000033 

Initial 

State  :  Z  2 

state 

CO 

C(2) 

cTTi 

C  ( 4 ) 

X 

2 ,CO?52i 

■  hum—— 

2 

2.256433 

0 . 341225 

0.353283 

0.647520 

J, 

0.262160 

0 . 136770 

0.042240 

0.009880 

3.691340 

0.775033 

0 .465763 

0.237122 

5 

0 .007520 

0 .001455 

3.CC3340 

C .001140 

6 

0 . CS6460 

0.003245 

0 . 0  4  4 1 6  C 

0.027360 

n 

0.222420 

0.2201 52 

0.200960 

0.201136 

C 

2 .024600 

0 . 0008 50 

0.011240 

0.027264 

3 

2 . 0  03200 

C.  202620 

0 . 0  Cl  3  2  0 

0  .  C  0  0 4 1 6 

^  j 

C .226600 

C.  01 5930 

C. 213130 

0.009984 

X  X 

0 . 0C94C0 

0 .200030 

0.000120 

0.C0CC43 

M  4- 

0.004600 

0.200172 

C .231280 

0.001152 

■*.  Jl 

0 .002080 

0.22  0  2-75 

C .C 00320 

0.000284 

-  ^ 

0.000920 

0  .  C  3  C  4  2  5 

2 .023680 

0 .006316 

1  5 

0 .000640 

2.001413 

0 .02 0440 

0 .002104 

1  ~ 

0.007360 

0.007990 

C  .025  0  6  3 

0 . 022496 

*  7 

0.000080 

0.020315 

3.20C04C 

G.C00012 

13 

C. 000920 

2.023235 

2. 0: 2460 

C  .  . cC 4C0 

lo  ‘J  O' ■  *’ fo  ►  - «  >  vD  OO  J  <J'  cn  U>  fsj  t-A  .C  fj  I  QJ  ^  O'  Ui  ^  W  l-J  h  ‘  O  Qj  ^4  q«  M  H 


Initial  State  :  Z  3 


ftate  cUTi 

cTH 

- cm - 

— cm - 

~ I  (5/3314^6 

—  II 11 1 1  — 

3.013910 

2  0.015S10 

0.077600 

0.004320 

0.002090 

3  0.22C430 

0.291000 

0.262030 

0.443115 

4  0.108570 

0.1940G0 

0.025920 

0.055385 

5  0.377830 

0.174600 

0.567840 

0.330475 

6  0.186120 

0.116400 

0.056160 

0.047025 

7  0.001675 

0.002400 

0.001365 

0.000712 

3  0.000325 

0.001600 

0.000135 

0.000033 

9  0 . 0 1 1 1 2  5 

O.OG6OOO 

0.008190 

0.018368 

10  0.005775 

0.004000 

0.000310 

0.002332 

11  0.020100 

0.003600 

0.017745 

0.016C20 

12  0.009900 

0.002400 

0.001755 

0.001930 

13  0.000335 

0.001200 

0.0C0455 

0.000173 

14  0.000165 

0 .000300 

0.000045 

0.00C022 

15  0.002345 

0.003000 

0.002730 

0.004717 

16  0.001155 

0.002000 

0.000270 

0.000533 

17  0.004020 

0.001300 

0.005915 

0.004005 

13  0.001950 

0.001200 

0.000585 

0.000495 

Lai  State  :  Z  4 

i  C[T) 

cm 

cm 

cm 

0. 002760 

■  HIIMIM 

—  II  1  1  1  1  1  M 

1  II  1  1  II  1  — — 

C .043240 

0 . 16490'0 

0.044160 

0.013240 

0 .026320 

0.072750 

0.023040 

0.020140 

C .302630 

0.412250 

0.264960 

0.433360 

Q .G45120 

0.043650 

0.049920 

0.017  ICO 

0.518530 

0.247350 

0.574080 

0.410400 

C  .C0020G 

0 .000600 

0.000120 

0 .GQ0032 

C.CC23C0 

0.003400 

0.001330 

0.000766 

0. 001400 

0.001500 

0.000720 

0.000848 

0.016100 

0.003500 

C.CCS280 

0. 020 3 52 

C.0C24C0 

0.000900 

0.001560 

0 . 0007 20 

0.C276C0 

0.005100 

0.017940 

0.017230 

0 .000040 

0.000300 

0.000040 

0.C00CC3 

0 .000460 

0.  GO  17 00 

0.000460 

0.000192 

0 . 000250 

0.000750 

0.000240 

0.000212 

C .003220 

0.004250 

0.002760 

C . CG5063 

0 .000430 

0.000450 

0.000520 

0.000130 

0.005520 

0.002550 

C.C059SC 

0.004320 

>  \ 

K'. 


Initial  State  :  2  5 


0 . uC37 2d 

0.003102 

0.003360 

0.000564 

0.001045 

0.007920 

0.125960 

0.053200 

0.006726 

0.016910 

0.256040 

0.062040 

0 .033300 

o.ooce64 

0.002090 

C .030960 

0.497542 

0 .517930 

0 . 356123 

0.820135 

0 . 330880 

0.245053 

0.345320 

0.064672 

0.101365 

0.023120 

0.000335 

0.000120 

0.000273 

0.000256 

0.005060 

0 . 0  0  0165 

0.000060 

0.000027 

0.000044 

0.000440 

0.006700 

0.001200 

0.000273 

0 . COO 7 12 

0.019730 

0.003300 

0.000300 

0 . C0C027 

0.000086 

0.001720 

0.026465 

0.010630 

C. 0267 54 

0.034532 

0.021160 

0.013025 

0.007120 

0.002646 

0.004263 

0.001840 

0 . 000067 

0.000060 

0.000091 

0.000089 

0.005060 

0 .000033 

0.000040 

0. 000  009 

0. 0000 11 

0.000440 

0.001340 

0.000600 

0.000091 

0.000173 

0.019760 

0.000660 

0.000400 

0 . 000009 

C.C0C022 

C .001720 

0.005293 

0.005340 

0.003913 

0.003633 

0.021160 

u • 002607 

0.003560 

0.000332 

0.001067 

0.001640 

•  i/»  L*t  ro»~*  o  vo  o>  -Jo*  rv» *  A  Id  I  m-  I  oj  -Jo>cn»f*  oj  m  » j  0^03 -JO'(.n*£»<>jrv.> 


.54$5a£> 
0.024420 
0.396640 
0.195360 
0.049530 
0.024420 
0.016750 
0  .  C  0  3  2  5  0 
0.134000 
0.066000 
3 . 0 16’’  50 
0.003250 
C .000670 
0.000330 
0.005360 
0.002640 
0.000670 
0.000330 


o.onloti 

0.011800 

0.332760 

0.221840 

0.003540 

0.002360 

0.012000 

0.008000 

0.225600 

0.150400 

0.GC2400 

0.001600 

0.000300 

0.000200 

0.005640 

0.003760 

0.000060 

0.000040 


0.218400 

0.021600 

0.300300 

0.029700 

0.027300 

0.002700 

0.136320 

0.013680 

0.190190 

0.01S810 

0.017290 

0.001710 

0.007280 

0.000720 

0.010010 

0.000990 

0.000910 

0.000090 


0.094785 

0.011715 

0.034710 

0.004290 

0.004005 

0.000495 

0.530796 

0.065604 

0.194376 

0.024024 

0.022423 

0.002772 

0.006319 

0.000781 

0.002314 

0.000286 

0.000267 

0.000033 


0.135 
0.016128 
0.026496 
0.002304 
0.008332 
0.000768 
0.579600 
0 .050400 
0.082800 
0.007200 
0.027600 
0.002400 
0.007728 
0 . 000672 
0.001104 
0.000096 
0.000363 
0.000032 


.al  State  :  Z  8 


?  cm 

— cm 

HH 

CTT) 

c  ( 5  5 

0 . 0  C  5  9  2  0 

57004425 

0.019200 

0.004250 

0.060450 

0 . 063030 

0.025075 

0.220800 

0.102240 

0.141120 

0.047260 

0 . 083 1 90 

0.026400 

0.001560 

0.008640 

0.544640 

0.471410 

0 . 303b00 

0.037440 

0.020160 

0.005920 

0.QCC885 

0.002400 

0.000180 

0.002330 

0.068030 

0.005015 

0.027600 

0.004320 

0.006720 

0 .002000 

0 .003000 

0.012160 

0.023656 

0.139000 

0.023000 

0.017000 

0.139840 

0.572544 

0.441000 

0.016000 

0.056400 

0.016720 

0.008736 

0.027000 

C.13400C 

0.319600 

C. 192280 

0.209664 

0.063000 

0.012000 

0.000600 

0.001520 

0.001008 

0.009000 

0.C23CC0 

0.003400 

0.017430 

0.024192 

0.021000 

0.000GS0 

0.000075 

0.000640 

0.000264 

0 . C  02  520 

0.0C0920 

0. DC  042 5 

0.007360 

0 .006816 

0.005380 

0 .  CO 0640 

C .001410 

0.000880 

0.000104 

0.000360 

0 . 007260 

0.007990 

C .010120 

0.002496 

0.000840 

C.C00C30 

0.000015 

0.000080 

0 . C00012 

0.000120 

0.000920 

0.000085 

0.000920 

0.000288 

0.000280 

*  -  a.  -a  «■»  >  «.>■»  fc  -m  ***.  lx 


b 

i 

—  nil  hi  Mm 

—mUTT'—l 

Timm— 

0.002670 

• 

2 

0.012210 

0.047200 

0.002700 

0.000330 

0.0C2496 

p 

3 

0.173530 

0.177000 

0.163800 

0.070755 

0.125356 

F 

4 

0.085470 

0.118000 

0.016200 

0.003745 

0.010944 

5 

0.297480 

0.106200 

0.354900 

0.060075 

0.C66240 

a 

6 

0 . 146520 

0.070800 

0.035100 

0.007425 

G. 005760 

7 

0.003375 

0.C48000 

0.017290 

0.014952 

0.089700 

,* 

3 

0.004125 

0.032000 

0.001710 

0.001843 

0.007600 

r. 

2 

0.053625 

0.120000 

0.103740 

0.396228 

0.393300 

10 

0 . 02387  5 

0.030000 

0.010260 

0.04S972 

0.034200 

V 

0.100500 

0.072000 

0.224770 

0 . 336420 

0.207000 

V 

12 

0 .049500 

0.043000 

0.022230 

0.041530 

0 .013000 

[y 

13 

0.000335 

0.001200 

0.000910 

0.000178 

0.001196 

14 

0.000165 

0.000800 

0.000090 

0.000022 

0.000104 

a 

15 

0. 002345 

0.003000 

0.005460 

0.C04717 

0.005244 

3 

16 

0.001155 

0.002000 

0.000540 

C .000533 

0.000456 

s 

17 

0.004020 

0.001800 

0.011330 

0.0040C5 

0.002760 

13 

0.001930 

0.001200 

0.001170 

0.000495 

0.000240 

1 

Initial 

State  :  Z  10 

Initial  State  :  Z  11 


state 

cm 

C  ( 2 ) 

cm 

cm - 

- - 

1 

0 . 603640 

0.00^319 

6.000400 

0.000375 

0.000320 

2 

0.000360 

0.000781 

0.004600 

0.002125 

0.003630 

3 

0.005005 

0.002314 

0.003200 

0.007050 

0.000440 

4 

0.000495 

0.000286 

0.036800 

0.039950 

0.005060 

5 

0.000455 

0.000267 

0.000400 

0.000075 

0.000040 

6 

0.000045 

0.000033 

0.004600 

0.000425 

0.000460 

7 

0.145600 

C. 056871 

0.002400 

0.003375 

0.012800 

3 

0.014400 

0.007029 

0.027600 

0.019125 

0.147200 

9 

0.200200 

0.020826 

0.019200 

0.063450 

0.017600 

10 

0.019800 

0.002574 

0.220800 

0.359550 

0.202400 

11 

0.013200 

0.002403 

0.002400 

0.000675 

0.001600 

12 

0.001800 

0.000297 

0.027600 

0.003325 

0.018400 

13 

0.214760 

0.568710 

0.005200 

0.003750 

0.018880 

14 

0.021240 

0.07029 0 

0.059800 

0.021250 

0.217120 

15 

0.295295 

0.208260 

0.041600 

0.070500 

0.025960 

16 

0.029205 

0.025740 

0.473400 

0.399500 

0.298540 

17 

0.026845 

0.024030 

0.005200 

0.000750 

0.002360 

16 

0.002655 

0.00297 0 

0.059800 

0.004250 

0.027140 

Initial 

State  :  Z  12 

state 

mm 

CTT) 

■  cm 

cm 

C(5) 

0.000284 

0.001675 

0.006000 

0.000455 

0.000178 

2 

0.006816 

0.000825 

0.004000 

0.000045 

0.000022 

3 

0.000104 

0.011725 

0 .015000 

0.002730 

0.004717 

4 

0.002496 

0.005775 

0. 010000 

0.000270 

0.000583 

5 

0.000012 

0.020100 

0.009000 

0.005915 

0.004005 

6 

0.000288 

0.009900 

0.006000 

0.000585 

0.000495 

7 

0.002556 

0.010050 

0.054000 

0.018200 

0.001602 

8 

0.061344 

0.004950 

0.036000 

0.001800 

0.000198 

9 

0.000936 

0.070350 

0.135000 

0.109200 

0.042453 

10 

0.022464 

0.034650 

0.C90000 

0.010800 

0.005247 

11 

0.000108 

0.12060 0 

0.081000 

0.236600 

0 .036045 

12 

0.002592 

0.059400 

0.054000 

0.023400 

0.004455 

13 

0.025560 

0.021775 

0.060000 

0.026845 

0.016020 

14 

0.613440 

0.010725 

0.040000 

0.002655 

0.001980 

15 

0.009360 

0.152425 

0.150000 

0.161070 

0.424530 

16 

0.224640 

0 .07507  5 

0.100000 

0.015930 

0.052470 

17 

0.001080 

0.261300 

0.090000 

0.348985 

G. 360450 

18 

0.025920 

0.128700 

0.060000 

0.034515 

0.044550 
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• 

V'/.V 


;/;-VA  *'•  v /"V*  -  v 


Initial  State  :  2  13 


i 


V 

s' 


V 


r 

s' 

’ 

y-: 


state 

cm 

— crm 

cU) 

cTTJ  *  ' 

1 

O'.  C63356 

~  0.00150(5 

0.O0364O 

6.00oOl9 

2 

0.001650 

0.001000 

0.000360 

0.000781 

3 

0.026800 

0.028200 

0.005005 

0.002314 

4 

0.013200 

0.013800 

0.000495 

0.000286 

5 

0.003350 

0.000300 

0.000455 

0.000267 

6 

0.001650 

0.000200 

0.000045 

0.000033 

7 

0 .020100 

0.013500 

0.145600 

0.056871 

3 

0 . 0  0  9  S  0  0 

0.009000 

0.014400 

0.007029 

9 

C. 160300 

0.253800 

0.200200 

0.020826 

10 

0.079200 

0.169200 

0.019800 

0.002574 

11 

0.020100 

0.002700 

0.018200 

0.002403 

12 

0.009900 

0.001800 

0.0018C0 

0.000297 

13 

0.043550 

0.015000 

0.214760 

0.568710 

14 

0.021450 

0.010000 

0.021240 

0.070290 

15 

0.348400 

0.282000 

0.295295 

0.208260 

16 

0.171600 

0.188000 

0.029205 

0.025740 

17 

0.043550 

0.003000 

0.026845 

0.024030 

13 

0.021450 

0.002000 

0.002655 

0.002970 

Initial 

State  :  Z  14 

state 

C(l) 

C(2) 

C(T) 

m) 

1 

0.000400 

0.000375 

0.000320 

0.000284 

2 

0.004600 

0.002125 

0.003680 

0.006816 

3 

0.003200 

0.007050 

0.000440 

0.000104 

4 

0.036800 

0.039950 

0.005060 

0.002496 

5 

0.000400 

0.000075 

0.000040 

0.000012 

6 

0.004600 

0.000425 

0.000460 

0.000288 

7 

0.002400 

0.003375 

0.012800 

0.002556 

8 

0.027600 

0.019125 

0.147200 

0.061344 

9 

0.019200 

0.063450 

0.017600 

0.000936 

10 

0.220800 

0.359550 

0.202400 

0.022464 

11 

0.0C2400 

0.000675 

0.001600 

0.000108 

12 

0.027600 

0.003825 

0.018400 

0.002592 

13 

0.005200 

0.003750 

0.018880 

0.025560 

14 

0.059800 

0.021250 

0.217120 

0.613440 

15 

0.041600 

0.070500 

0.025960 

0.009360 

16 

0.478400 

0.399500 

0.293540 

0.224640 

17 

0.005200 

0.000750 

0.002360 

0.001080 

13 

0.059800 

0.0C4250 

0.027140 

0.025920 

K 


t: 


W”-' 


84 


W,"  *  "  *v 


if  ■  i  >  nil  r»u  iu 


Initial  State  :  2  15 


state 

cm  ■ 

cm 

cm 

cm 

1 

—  II  1  n  If  1  — 

— 11 1 1  n  i  — 

0.000455 

0 . dO  0 1 7  8 

2 

0.C00325 

0.004000 

0.000045 

0.000C22 

3 

0.011725 

0 .015000 

0.002730 

0.004717 

4 

0.005775 

0.010000 

0.000270 

0.000583 

5 

0.020100 

0.009000 

0.005915 

0.004005 

6 

0.009900 

0.006000 

0.000535 

0.000495 

7 

0.C10050 

0.054000 

0.018200 

0.001602 

3 

0.004950 

0 . 036000 

0.001800 

0.000198 

9 

0.070350 

0.135000 

0.109200 

0.042453 

10 

0.034650 

0.090000 

0.010800 

0.005247 

11 

0.120600 

0.081000 

0.236600 

0.036045 

12 

0.059400 

0.054000 

0.023400 

0.004455 

13 

0.021775 

0.060000 

0.026845 

0.016020 

14 

0.010725 

0.040000 

0.002655 

0.001980 

15 

0.152425 

0 .150000 

0.161070 

0.424530 

13 

0.075075 

0.100000 

0.015930 

0.052470 

17 

0.261300 

0.090000 

0.343985 

0.360450 

13 

0.128700 

0.060000 

0.034515 

0.044550 

Initial 

State  :  Z  16 

state 

HBtHH 

C(2 ) 

HHBHI 

cm 

i 

IMTITTTTTMM 

0.001500 

0.000040 

0.000008 

2 

0.002300 

0.008500 

0.000460 

0.000192 

3 

0.001400 

0.003750 

0.000240 

0.000212 

4 

0.016100 

0.021250 

0.002760 

0.005088 

5 

0.002400 

0.002250 

0.000520 

0.000180 

6 

0.027600 

0.012750 

0.005980 

0.004320 

7 

0.001200 

0.013500 

0.001600 

0.000072 

8 

0.013800 

0.076500 

0.018400 

0.001728 

9 

0.008400 

0.033750 

0.009600 

0.001908 

10 

0.096600 

0.191250 

0.110400 

0.045792 

11 

0.014400 

0.020250 

0.020800 

0.001620 

12 

0.165600 

0.114750 

0.239200 

0.038880 

13 

0.002600 

0.015000 

0.002360 

0.000720 

14 

0.029900 

0.085000 

0.027140 

0.017280 

ID 

0.018200 

0.037500 

0.014160 

0.019080 

16 

0.209300 

0.212500 

0.162840 

0.457920 

17 

0.031200 

0.022500 

0.030680 

0.016200 

13 

0.358800 

0.127500 

0.352820 

0.388300 

85 


nitial  State  :  Z  17 


state 

cm 

WKBSVEK 

mm - 

- CTJ1 - 

cm 

1 

1 1I  I  I  I  1 1  M 

—-im-rr-y 

iSMfiMiritnW 

■HI 

2 

0.000165 

0.000200 

0.000009 

0.000011 

0.000704 

3 

0.006700 

0.003000 

0.000091 

0.000178 

0.031648 

4 

0.003300 

0.002000 

0.000009 

0.000022 

0.002752 

5 

0.026465 

0.026700 

0.008913 

0.008633 

0.033856 

6 

0.013035 

0.017300 

0.000882 

0.001067 

0.002944 

7 

0.002010 

0.002700 

0.003640 

0.000801 

0.040430 

8 

0.000990 

0.001300 

0.000360 

0.000099 

0.003520 

9 

0.C40200 

0.027000 

0.003640 

0.001602 

0.158240 

10 

0.019800 

0.013000 

0.000360 

0.000198 

0.013760 

11 

0.153790 

0.240300 

0.356720 

0.077697 

0.169280 

12 

0.073210 

0.160200 

0.035230 

0.009603 

0.014720 

13 

0.004355 

0.003000 

0.005369 

0.008010 

0.052624 

14 

0.002145 

0.002000 

0.000531 

0.000990 

0.004576 

15 

0.037100 

0.030000 

0.005369 

0.016020 

0.205712 

16 

0.042900 

0.020000 

0.000531 

0.001980 

0.017888 

17 

0.344045 

0.267000 

0.526162 

0.776970 

0.220064 

13 

0.169455 

0.178000 

0.052038 

0.096030 

0.019136 

Initial 

State  :  Z  18 

state 

BHBMB 

C(2) 

c(3) 

cm 

mm 

1 

iSMaWiMiTiT'  TiBb 

0.000075 

Mill  1 1 1 IM 

0. 600004 

MHIIII  !■ 

2 

0.000460 

0.000425 

0.000092 

0.000096 

0.006160 

3 

0.000800 

0.000750 

0.000008 

0.000008 

0.010320 

4 

0.009200 

0.004250 

0.000092 

0.000192 

0.024080 

5 

0.003160 

0.006675 

0.000784 

0.000388 

0.011040 

6 

0.036340 

0.037325 

0.009016 

0.009312 

0.025760 

7 

0.000240 

0.000675 

0.00C320 

0.000036 

0.013200 

8 

0.002760 

0.003825 

0.003680 

0.000864 

0.030800 

9 

0.004800 

0.006750 

0.000320 

0.000072 

0.051600 

10 

0.055200 

0.038250 

0.003680 

0.001728 

0.120400 

11 

0.018960 

0.060075 

0.031360 

0.003492 

0.055200 

12 

0.218040 

0.340425 

0.360640 

0.033808 

0.128800 

13 

0.000520 

0.000750 

0.000472 

0.000360 

0.017160 

14 

0.0C5980 

0.004250 

0.005428 

0.008640 

0.040040 

15 

0.010400 

0.007500 

0.000472 

0.000720 

0.067080 

16 

0.119600 

0.042500 

0.005428 

0.017280 

0.156520 

17 

0.041080 

0.06675 0 

0.046256 

0.034920 

0.071760 

13 

0.472420 

0.378250 

0.531944 

0.838080 

0.167440 

Goodness  Measurements 


State 

Z(i) 

Combination 
vail  vai2 

val3 

Goodness  Remarks 
value 

1 

o.co 

o.co 

b.ot 

(T7£o 

2 

0.00 

0.00 

1.00 

1.00 

3 

0.00 

0.50 

0.00 

0.50 

4 

0.00 

0.50 

1.00 

1.50 

5 

0.00 

1 .00 

0.00 

1.00 

6 

0.00 

1.00 

1 .00 

2.00  ideal 

7 

0.50 

0.00 

0.00 

-0.50 

3 

0.50 

0  .  GO 

1.00 

0.50 

9 

0.50 

G  .  50 

0.00 

0.00 

1C 

0.50 

0.50 

1.00 

1.C0 

11 

0.50 

1.00 

0.00 

0.50 

12 

0.50 

1.00 

1.00 

1.50 

13 

1.00 

0.00 

0.00 

-1.00  anti-ideal 

14 

1.00 

0.00 

1.00 

0.00 

15 

1.00 

0.50 

0.00 

-0.50 

16 

1.00 

0.50 

1.00 

0.50 

17 

1.00 

1.00 

0.00 

0.00 

18 

1.00 

1.00 

1.00 

1.00 

Benefit  Matrix 


State  Z(i)  C(l)  C( 2)  C(3)  C(4)  C(5) 


1 

i 

0.795000 

6. 860600 

0.390000 

(3.240060 

2 

0.385000 

0.310000 

0.220000 

0.090000 

3 

0.570000 

0.430000 

0.365000 

0.295000 

4 

0.160000 

-0.120C00 

0.195000 

0.145000 

5 

0.135000 

0.320000 

0.050000 

0.060000 

-0.320000 

6 

-0.225000 

-0.230C00 

-0.120000 

-0.090000 

-0.700000 

7 

1.195000 

1.170000 

0.705000 

0.340000 

0.295000 

3 

0.785000 

0.620000 

0.535000 

0.190000 

-0.085000 

9 

0.970000 

0.740000 

0.680000 

0.395000 

0.280000 

10 

0.560000 

0.190000 

0.510000 

-0.970000 

-0.345000 

11 

-0.875000 

-1.175000 

0.120000 

0.105000 

-0.045000 

12 

-1.325000 

-1.195000 

-1.275000 

-1.400000 

-1.620000 

13 

1.030000 

1.155000 

0.625000 

0.325000 

14 

0.620000 

0.605000 

0.455000 

0.175000 

15 

0.805000 

0.725000 

0.600000 

0.380000 

16 

0.395000 

0.175000 

0.430000 

0.230000 

17 

0.420000 

0 .615000 

0.285000 

0.145000 

0.035000 

18 

0.010000 

0.065000 

0.115000 

-0.005000 

-0.345000 

S7 


State 

Z(i) 


Choice  Policy 
C(k) 


1  1 

2  1 

3  1 

4  3 

5  1 

6  4 

7  1 

8  1 

9  1 

10  4 

11  4 

12  2 

13  1 

14  2 

15  1 

16  3 

17  1 

IS  4 


set  arbitary  v(18)  to  0 
maxincome  per  period  :  5 .412337245E-16 
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